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ABSTRACT 



The use of interactive computer graphics in the construc- 
tion of animated visual displays is investigated. 

The dissertation presents a process called interactive 
computer-mediated animation , in which dynamic displays are 
constructed by utilizing direct console commands, algorithms, 
free-hand sketches, and real-time actions. The resulting 
"movie" can then be immediately viewed and altered. 

The dissertation also describes a special kind of inter- 
active computer-mediated animation that exploits the poten- 
tialities of direct graphical interaction. The animator may 
sketch and refine (l) static images to be used as components 
of individual frames of the movie, and (2) static and dynamic 
images that represent dynamic behavior, that is, movement and 
rhythm. Because these latter pictures drive algorithms to 
generate dynamic displays, the process is called picture-driven 
animat ion . 

Each representation of movement and rhythm determines 
critical parameters of a sequence of frames. Thus, with a 
single sketch or action that generates or modifies the re- 
presentation, the animator can exercise dynamic control 
over an entire interval of the movie. One natural way to do 
this is by mimicking in real time a movement or a rhythm, 
using a stylus or a push-button. 

These concepts are supported by experience with three 
special-purpose picture-driven animation systems which have 
been implemented and used on the M.I.T. Lincoln Laboratory 
TX-2 computer. 
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The dissertation also presents an outline of the_proposed 
design of a multi-purpose, open-ended, interactive Animation 
and Picture Processing Language. APPL is a conversational 
language which accepts direct sketches, direct console com- 
mands, and algorithms that control interactive dynamic dis- 
plays . 

Solutions are presented for the following problems: 
How can the system be structured so that the command set can 
easily be augmented by the animator? How can movie time be 
represented in the language, and how does the choice of 
representation interact with the flow of program and system 
control? What computational data structure can facilitate 
the modeling of sequential and hierarchic structures of pic- 
tures and dynamic data? How can we provide a rich picture 
description capability in the language? How can we facilitate 
the construction of programs which describe the user's inter- 
action with the system? 

APPL programs are included to demonstrate that the lan- 
guage can be gracefully used to construct dynamic displays, 
to build system tools that aid the construction process, and 
to implement special-purpose interactive computer-mediated 
animation systems. 



Thesis Supervisor: Edward L. Glaser 

Title: Associate Professor of Electrical Engineering, M.I.T. 
(currently Chairman, Department of Information and 
Computer Sciences, Case Western Reserve University) 
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PREFACE AND ACKNOWLEDGMENTS 



Several {rlends have. asked me, with perhaps a tinge o{ 
envy In their voices, how I was {oKtu.na.tn enough to {Ind a 
thesis topic that, bat {on. the lmx.0A.abl2. pressure {rom a cer~ 
tain dra{t, could have, been {an. 

The thesis began with an Illation o{ Inspiration and my 
good {ortane In being In Boston at a time. when lnte.tte.At In 
compute,*, animation was high. Two Ideas ke.pt me. awake, one, 
night In Nove.mbe.ti o{ 1 966--one was so specl{lc that It was 
never used, the, other so ge.ne.Kal that the. diss ertatlon barely 
scratches Its surface.. Vet a {also. Eureka Is be.tte.tt than none,, 
and he, who thinks he. has {ound a promising trail has at le.ast 
{ound a trail. At that time, talks with Wally Ve.aerze.lg and 
Ted Myer at Bolt, Beranek, and Hewman had already awakened my 
lnte.re.st In computer animation. Processor Seymour Papert at 
M.I.T. suggested work on a language {or animating stick {Igares . 
Processor Ivan Sutherland, now at the, University o{ Utah but 
then at Harvard, proposed use o{ wave{orms to de{lne changing 
picture parameters, and Tim Johnson o{ M.I.T. enlarged upon 
this suggestion. Group 23 o{ Lincoln Laboratory had already 
o{{ered use o{ the TX-2 computer with Its superb graphics 
hardware and software, a system with which I had become {amlllar 
during a summer's work on the Interface o{ graph theory and 
graphics . So, late In December o{ 1966, I began work on a 
stick {Igure animation program. 

By early March a lone stick {Igure, headless but opti- 
mistic, took Its {Irst {altering steps across a TK-2 scope. 
Soon Eric Martin, {rom the Harvard Carpenter Center {or the 
Visual Arts and Cambridge design Group, Inc., and I were 
beginning to learn how to control Its dynamics by crudely 
sketching and resketchlng wave{orms . Thus we began Interactive 
co mp uter- mediated animation. 
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Somewhat earlier, I had begun Intensive and fior me 
thought-provoking discussions on computus animation with 
Processor Edward L. Glaser o& M.I.T., who since then has 
b2.com 2. Ch.atx.man o (J the V2.pas1tme.nt o& Information and Compute.*. 
Sciences at Case Western Re.62.rve. University In Cleveland. In 
May of) 7967 7 submitted a thesis proposal, with V ro { es s r 
Glaser as mentor. The. proposal stressed the, synthesis 0$ 
movement through the. sketching and graphical editing & 
waveforms , and the. creation o{ an animation language. In which 
picture,* could be Implicitly described and retrieved In terms 
o{ their "properties ." 

A^ter a summer spent on graphical debugging , I began In 
October the design 0^ an Interactive animation language. 
There boon followed a premature and abortive attempt at an 
Implementation oh the yet fuzzily- defined language. In re- 
sponse to the pressure oi a speaking commitment to a group 0^ 
artists, I returned to the TX-2 to generate more example* o£ 
computer animation. I grafted ^rom the stick figure system 
(APAM) an abstract dynamic art program {EVE}. Having just de- 
viled the p-curve as an alternate approach to the specification 
0(5 continuous movement, 1 designed EVE to Illustrate graphically 
the power o& the dynamic mimicking oi a motion and Its record- 
ing by the computer $or use In an animated display. {In this 
goal I apparently succeeded, lor one Hew York avant-garde 
^llm-maker, excited by some animation fragments farom El/E, 
responded, "Man, that's pure underground- -pure underground 1 .") 

I also constructed a simplified animation system In 
which one could sketch components ol frames. This appealed 
to the artist In Eric In a way that the other two systems had 
not. I then realized the need to couple the richness o<$ 
dynamic control awarded by the use oi waveforms and p-curves 
with the richness 0^ static Imagery to which artists and 
animators were accustomed. The ability to use waveforms and 
p-curves to define the translation oi arbitrary sketched 
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Images , now part ol the animation system, was clearly lnsu{- 
llclent. Eric continued to stress, and J continued to resist, 
tk<i notion that animation required discrete picture change, as 
well as conttnu.ou.-6 move.me.nt. ijJkat troubled me was an. apparent 
conceptual gap be.tMe.tn continuous movement and discrete pic- 
ture, change., and ho I returned to the. drawing board {on. another 
pass at the. language. design. 

Suddenly, In late spring o{ 19 6 8, the. alternation b2.tui2.zn 
practical computer animation attempts and conceptual language 
design began to pay oil, just as Prolessor Glaser had antici- 
pated all along. A solution began to gel, one In which there 
were nice parallels between continuous and discrete, picture 
change, between continuous and discrete movement, between con- 
tinuous pictorial operations such as translation and discrete 
pictorial operations such as Insertion and deletion, and 
between continuous picture attributes defining coordinates 
and discrete picture attributes defining structure. A view- 
point was crystallized In which certain classes o{ data 
sequences , called global descriptions ol dynamics , were used 
as characterizations and generative dellnltlons ol ongoing 
picture change, and In which classes o{ static and dynamic 
pictures were used as dellnltlons and synthetic tools {or 
manipulating global dynamic descriptions . 

There was su{{lclent advance on two Ironts, throughout 
the summer and lall o{ 196&, so that the thesis o{ the dis- 
sertation, stated In the Introduction, could be supported, 
first, the animation system quickly grew Into something quite 
dlHerent and ol considerably more power, the GESIEr allzed- eel 
Animation SVStem [GEMESYS). As crocodlless es began to cavort 
across the TX-2 screen, picture-driven animation became a 
practical reality. Second, the Animation and Picture Pro- 
cessing Language (APPL) was re{lned through the paln{ul con- 
struction and testing on paper o{ algorithms that defined 



both dynamic dl*play* and *peclal-purpo*e j-nte.fiact.ivz 
computer- mediated animation *y*tem*. 



And now the. dl**e station I* complete.. Many Individual* , 
including tho*e already cited, have, contributed to the pro- 
gre** o{ tho. re* earch . It I* with deep appreciation that I 
acknowledge-. 

V 'no { e* * o r Edward L. Gla*er, {or hi* encouragement, hi* wae 
and patient coun*el, hi* Insight, and hi* co ntaglou* 
enthu*la*m and {alth In the. importance o{ computer, anima- 
tion; 

Dr. William R. Sutherland o £ MIT Lincoln Laboratory , {or hi* 

constant *upport and expre** ed confidence In my work, hi* 
many careful reading* o fa chapter dra{t* , and our numerou* 
thought-provoking dl*cu**lon* ; 

?ro{e**or Murray Eden, {or hi* kind advice and guidance through- 
out my year* at MIT, and hi* valuable comment* on the 
manu*crlpt; 

Mr, Eric Martin, {or hi* {reely-glven time and *plrlted lntere*t 
In dl*cu**lng and experimenting with animation *y*tem*; 
{by the way, Eric, the *y*tem I* beginning to look a* l{ 
It might po**lbly *oon be almo*t cra*h- {ree and bug-proo {, 
I h o p e . . , ) ; 

Mr. lame* E. Curry o{ Adam* A** oclate* , {or hi* thoughtful 
*uggz*tlon* on part* o{ the dl**ertatlon; 

Mr. Timothy John*on o{ MIT, Vr. Amedlo Armentl o{ Lincoln 

Laboratory , and ?ro{e**or Adol{o Guzman o{ MIT, {or their 
comment* on the manu*crlpt; Mr. Jack Nolan and Mr. Robert 
Vavl* o{ Lincoln Laboratory , and ?ro{e**or Thoma* G. 
Stockham, Jr., {or advice and a**l*tance; 

The Digital Computer* Group[23) o{ MIT Lincoln Laboratory , {or 
*ta{{ *ervlce* t computer time, and *tlmulatlng environ- 
ment o{ many talented pro{e**lonal* ; Specific contribu- 
tion* have come {rom Mr. C. S. Lin, who de*lgned the 
circuit linking the movie camera to the computer, and 
Mr. Robert McCormack and Mr*. Nancy John*on o{ Adam* 
A**oclate* , who programmed part* o{ GENESYS; 

Mr. Ephralm Cohen, Mr*. John*on, Ml** Barbara Koppel, and Ml** 
Lynn Smith, {or their generation o{ experimental mini- 
car toon* , and. {or their help{ul comment* on GENESYS; 

Mr*. Llla Hartmann, {or her typing o{ the {Inal copy; 
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APAM, EVE, and GEUESYS, ^or a**ibtance in preparing the illus- 
tration* fiound In the di** dotation; it i* bs.l-ie.ve.di, Inci- 
dentally, that all movie* firom which {rame* are included 
Mould obtain one f$ the following tixio rating* under the 
Motion Picture Code o$ Selfi-Regulation, either G, *ugge*ted 
i on - GENERAL audience* , on. M, *ugge*ted lor MATURE 
audience* [parental di*cretion advi*ed)-, 

\Kr. Robert Goldberg, Mi** Patricia Lewi* , my *i*ter, and my 
parent* , ^or their help in numerou* way*, at numerou* 
time* . 

I al*o with to thank the other*, namele** but not forgotten, 
tx>ho have helped. 

Any error* remaining in the manu*cript are & cour*e solely my 
responsibility . 
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SELECTION DESCRIPTIONS (l) 

Picture changes that are recurring discrete 

choices of pictures, data, events, or 

actions are expressed by selection 

. , . ■ — oO 

aes cr ipt 1 ons 

RHYTHM DESCRIPTIONS 

Rhythm descriptions express patterns of the 
triggering, pacing, coordination, and 
synchronizing of picture change 
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I.E. EXPLORATORY STUDIES IN PICTURE-DRIVEN ANIMATION 
There are presented results, observations, 
and interpretations from the use of the three 
picture-driven animation systems that have 
been implemented on the M.I.T. Lincoln 
Laboratory TX-2 computer 1 *° 

1. CONSTRUCTING, VIEWING, AND FILMING 
MOVIES ON THE TX-2 

Features of the movie construction, 

playback, and filming processes, common 

to all three systems, are described _L4y 

2. ADAM 

This is a special-purpose system for 

the animation of a stick man 1 ^ 1 

3. EVE 

This is a special-purpose system for 

the animation of an abstract figure - L - J " 

U. GENESYS--THE GENE RALI ZED-CEL 
ANIMATION SYS TEM 
The process of using GENESYS 
is further clarified 

Footnotes to I.E -^^ 
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I.F. CQNCLUSION--THE REPRESENTATION OF 
DYNAMIC INFORMATION — THE CONCEPT 
OF A DYNAMIC DISPLAY 

Picture-driven animation is summarized and 
its advantages characterized. To exploit 
these advantages, the animation system must 
allow a plastic relationship among global 
dynamic descriptions, pictures, and 
processes of picture construction 
( act ions ) --they must be interchangeable 
representations of dynamic behavior and 
equivalent components in the generation of 
dynamic displays. Thus, further motivation 
for the design of an extensible animation 
system is developed 
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II. A. A GENERAL INTRODUCTION TO THE DESIGN OF AN 
OPEN-ENDED, MULTI-PURPOSE, INTERACTIVE 
COMPUTER-MEDIATED ANIMATION SYSTEM l8 ^ 

Aspects of the design are motivated in 
terms of the relevant history of 
computer graphics and animation: 

1. THE ESSENTIAL FEATURES OF SKETCHPAD, 

BEFLIX, AND CAFE l85 

2. SOME SPECIFIC ISSUES RAISED BY BEFLIX, 

CAFE, AND GENESYS 192 

The system must be open-ended--t he 
directly executable commands funda- 
mental to any interactive computer 
graphics system must also serve as 
statements in a complete programming 
language, one which is capable of 
definitional extension. This conver- 
sational language will be called APPL, 
an Animation and Picture Processing 
Language : 

3. ESSENTIAL FEATURES IN THE DESIGN OF APPL. . 195 

k. A SCENARIO ILLUSTRATING SOME USES OF APPL . 199 

5. IMPLICATIONS OF THE SCENARIO 

The system is flexible and multi- 
purpose, for it may be used: 

(l) to construct animated visual displays, 
by directly designating a sequence of 
APPL commands for immediate execution, 
or by writing a program in APPL; 
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(2) to build system tools that aid the 
construction process; and, 

(3) to implement special-purpose inter- 
active computer-mediated animation 
systems 2 00 

6. WHAT IS TO COME, AND WHAT IS NOT 
TO GOME, AND WHY 

The language is developed in the next 
four chapters; the philosophy of the 
presentation is stated here ^ 1C 

Footnotes to II. A 212 

II. B. THE INCORPORATION OF A COMMAND LANGUAGE INTO 

AN ANIMATION PROGRAMMING LANGUAGE 21 k 

1. COMMANDS AND PICTORIAL DATA IN APPL 
The interaction of a user with APPL 
results In the creation of a pic- 
torial data base consisting of 
structured collections of pictures 

and numbers 215 

2. EXTENDING THE COMMAND STRUCTURE 
Arbitrary command sequences may be 
saved for delayed execution under 
system-directed flow of control. 
New commands so defined may be 
nested to arbitrary depth; hence 

the language is open-ended ?1 9 

3. THE SCOPE ISSUE 

The Issue of the scope and binding 

of names in programs is discussed. 

A distinction is made between the one 

global (system-wide) pictorial data 

base, and various local data bases 

belonging to individual programs 2 22 

Footnotes to II. B 22 5 

II. C. THE INTERACTIVE DEFINITION OF 



DYNAMIC DISPLAYS IN APPL 



TEE INDIVIDUAL CONSTRUCTION OF 

EACH FRAME IN THE SEQUENCE 

The use of APPL in the individual 

sketching of a sequence of frames 

is illustrated 2?7 
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THE GENERATION OF FRAMES FROM AN 
ALGORITHMIC DESCRIPTION OF THE 
SEQUENCE — THE CONCEPT OF MOVIE TIME 
An example of the algorithmic defini- 
tion of a dynamic display is presented 
and analyzed, with particular concern 
for the implications of real time 
construction and playback of the 
movie. The discussion motivates the 
introduction of the concept of simu- 
lated, or movie time 230 

THE MODULAR DEFINITION OF CONCURRENT 

DYNAMIC ACTIVITIES 

A mechanism of program control, 

q.uas i-parallel processing , is adopted 

from simulation languages to facilitate 

the specification of parallel actions 

in a movie 
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4. THE FLOW OF CONTROL AMONG INTERACTIVE 
APPL PROGRAMS 

Control is distributed, during the 
passage of movie time, among instances 
of APPL programs in quasi-parallel 
execution. A mechanism called the 
agenda mediates the flow of control. 
Particular emphasis is placed on the 
effect one program can have on 
another, and on ways the animator's 
use of the stylus, push buttons, and 
other devices can affect the flow of 
control and the passage of movie time.. . . 2 '+ 1 

Footnotes to II, C 251 

II. D. APPL'S DATA STRUCTURE FOR MODELING 

PICTURES AND GLOBAL DYNAMIC DESCRIPTIONS . . . . ? 52 

1. DESIGN CRITERIA FOR A DATA STRUCTURE 
The goals are related to the needs 
for sequential and hierarchic struc- 
tures in animation and picture 
processing 2 53 



-15- 



2. THE AGGREGATE 

This data structure shares certain 
features with (ordered) sets, arrays, 
and rings, and is a generalization 
of all ordered hierarchic data 
representations. Linguistic con- 
structs for its manipulation are 
enumerated. The assignment of names 
to values and the issues of struc- 
ture sharing are discussed 256 

3. AN ILLUSTRATION OF MODELING COMPLEX 

PICTURES BY PICTORIAL AGGREGATES 267 

k. ILLUSTRATIONS OF MODELING GLOBAL 
DYNAMIC DESCRIPTIONS BY 
SCALAR AGGREGATES 270 

The parallel mechanisms for representing 
structured pictures and dynamic descrip- 
tions allow a very plastic representation 
of dynamic information. It also facili- 
tates the implementation, through 
extensions of APPL, of the mechanisms 
required for picture-driven animation: 

5. PICTURE-DRIVEN ANIMATION IN APPL 2 72 

Footnotes to II. D 276 

II. E. MECHANISMS FOR DESCRIBING AND MANIPULATING 

STRUCTURED PICTURES IN APPL . '. '. '. ; '. ~ . . . 2 ? 7 

1. ATTRIBUTES AND PROPERTIES OF PICTURES 
An attribute is a scalar-valued or 
picture-valued function of a picture. 
The value of an attribute of a pic- 
ture is called a property . Sub- 
pictures possessing certain properties 
may be isolated by the application of 

a picture selection function 2 ?^ 

2. THE DEFINITION OF NEW PICTURE TYPES 
The type attribute distinguishes 
classes of pictures with individual 
characteristic features. The user 
may extend the descriptive capability 
of his language by defining new 

picture types 287 
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3. AUXILIARY DEFINITIONS OF PICTORIAL 
ATTRIBUTES AND OPERATIONS 
He further extends his ahility to 
manipulate classes of pictures by 
defining new attributes, and by 
making auxiliary definitions of 
attributes and operations which 

refer to their behavior when , 

applied to pictures of a new type.. . . - - 

Footnotes to II. E 
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III. A. SUMMARY AND CONCLUSIONS 3 °3 

III.B. DISCUSSION AND SUGGESTIONS FOR FUTURE WORK 
This chapter further comments upon and 
criticizes the dissertation, points out 
what has not yet been accomplished, and 
suggests what should next be done in 
interactive computer-mediated animation. . 

1. DIFFICULTIES ENCOUNTERED IN 
IMPLEMENTING AND USING 
ADAM, EVE, AND GENESYS 
These problems are described with 
reference to published literature 
on components of the TX-2 inter- 
active graphics environment 

With respect to picture-driven 
animation and the proposed design 
of APPL, the development of future 
interactive animation systems is 
considered, and some unanswered 
questions are posed for future 
res earch . 

2. WHAT TO DO NEXT IN PICTURE-DRIVEN 
ANIMATION 320 

3. THE IMPLEMENTATION AND FURTHER 
GENERALIZATION OF APPL 321 

k. HOW SUPPORTING SUBSYSTEMS, BOTH 

HARDWARE AND SOFTWARE, COULD BETTER 
FACILITATE INTERACTIVE COMPUTER- 
MEDIATED ANIMATION 
Some avenues of research towards better 

environments for interactive animation 

32 4 
aresuggested. . . 
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5. THE FEASIBILITY OF IITEMQTIVE 
COMPUTER*ME©IA^B ARI^AtiaH 

A number of f act**** wili determine 
the economic and practical ,Ti*^>^- 
ity, pretext and future 4 -af inte*^ 
active compMer^*44j*%ed animation. 

6. applications of iw&mc* f?E 

COMPUTER-MEDIATED AfflMATIO* 
Uses in educational filmmaking, 
psychology, psychiatry, and the 
arts are discussed. « --:« . « \ . . . 

Footnotes to III.B 
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WHAT IS ANIMATION? 



***Anlmatlon li not the ant o£ VRA01INGS- that-mova 
but the ant Of, tiOJSE?AENZS-that-ane.-dnawn . 

***What happens between tach {name l& mone, important 
than what e.xl6ti ojn each {name,. 

***Anlmatlon l& thene{one, the aKt o { manipulating 

the Invisible lnte,n&tlces that lie, be.tiVQ.nn {names . 



The. lnte,nstlces an. 2. the bon2.A, {lesh and blood { the 
movie, what Is on e,ach {name,, me.ne.ly the, clothing. 



Nonman McLanen [ * 7 ] 
National Film Bo and- -Canada 



This dlsse,ntatlon may be, neganded In pant ai> an Investigation 
o{ the use & the. compute.*. In "the, ant o{ MOV EVENTS - that- ane- 
dnawn , " In the manipulation o{ "the. invisible Intent* tlcas that 
lie be.tn>ee.n {names . " 



All {ootnote,s [*...] may be {ound at the e.nd oi the, Chapte,n 
In which they occun. |*7) lb located on page, 34. 
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Animation is tke graphic art wkick occurs in time. 
Wkereas a static image, [tuck as a Picasso on a complex graph) 
may convey complex information through a single picture, 
animation convey*, equivalently complex information tkh.ou.gh 
a. sequence o^ images seen in time. It is ckaA.actz.sii6 tic o & 
this medium, as opposed to static imagery, that tke actual 
graphical information at any given instant is relatively 
sligkt. Tke source o^ information ion. tke viewer o& animation 
ii> implicit in picture ckange: ckange in relative position, 
skape, and dynamics . Therefore, a computer is ideally suited 
to making animation "possible" tkrougk tke {luid refinement 
o{ tkese change* . 



Eric Martin 

Carpenter Center ^or 

tke Visual Arts , 
harvard University , 

and 
Cambridge design Group, Inc. 
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INTRODUCTION 

The animation industry is ripe for a revolution. 
Historical accidents of available technology and knowledge 
of visual physiology have led to the evolution of the ani- 
mated film as "one that is created frame-by-frame." The 
prodigious quantities of labor required for the construction 
of twenty-four individual frames per second of film have led 
to a concentration of animation activity in the assembly- 
line environments of a few large companies, an artificial 
yet rarely surmountable separation of the artist from his 
medium, and extravagant costs. ( *2 ) In conjunction with 
other trends in American society, the result is usually what 
the English critic Stephenson describes as "the respectable 
sadism and sterotype of commerce." Yet he offers this hope- 
ful prediction in concluding his 1967 study, Animation in the 
Cinema : "There seems every reason to look forward to changes 
which would make It possible for the creative artist to put 
on the screen a stream of images with the same facility as 
he can now produce a single still picture." This paper 
explains how a creative artist, aided by a computer, can de- 
fine a stream of images with the same facility as he can now 
produce a very few still pictures. 

Although the computer's entrance into animation has been 
a recent one ( 1 9 6 U ) , ' the growth of interest and activity 
has been phenomenal. ~ (*3,*^) Experience to date strongly 



-21- 



suggests that the following statements are true: 

(1) The animated display is a natural medium for the record- 
ing and analysis of computer output from simulations and 
data reduction, and for the modeling, presentation, and 
elucidation of phenomena of physics, "biology, and engi- 
neering. Depiction through animation is particularly 
appropriate where simultaneous actions in some system 
must be represented. If the animation is the pictorial 
simulation of a complex, mathematically-expressed physical 
theory, then the film can only be made with the aid of a 
computer . 

(2) The computer is an artistic and animation medium , a 
powerful aid in the creation of beautiful visual 
phenomena, and not merely a tool for the drafting of 

4.-4-- ■ + 21-25 
regular or repetitive pictures. 

(3) The formal modeling of pictures by complexes of algo- 
rithms and data facilitates the continued modification 
of a single animation sequence and the production of a 
series of related sequences. 

This dissertation is a study of ways in which man, aided 
by a computer in an interactive graphical environment, can 
synthesize animated visual displays. I stress the coincidence 
of the words "interactive" and "graphical"; the animator must 
interact directly with the production of his film in a way 
which may truly be called graphical, that is, by sketching and 
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modifying pictures, and by viewing in real time successive 
versions of the movie. (*5) 

Computer animation is the process of constructing 
animated films using a computer. The approach of this dis- 
sertation differs significantly from that of past (and, to 
the best of my knowledge, present) work in computer animation. 
The difference is reflected in the phrase, "interactive 
computer-mediated animation. 1 ' I use this terminology to 
stress that the computer is a medium with which the animator 
int eract s graphically to create dynamic displays. These may 
later be recorded on photographic film or video tape, but 
this is not an essential part of the process. 

We begin, therefore, by reviewing other work in computer 
animation. Central to the design of any animation system is 
the choice of the style and extent of man-machine communica- 
tion best suited to potential users of the system. (*6) We 
shall look at the choice that has been made in several digital, 
hybrid, and analog computer systems. 



-23- 



Digital Computer Systems 

All "but two computer animation projects have used 
general-purpose digital computers, with punched-card or 
typewriter input of written language, and off-line movie 
output to a microfilm recorder or scope-mounted camera. The 
animator generally submits a movie as a deck of punched cards, 
and views the resulting film hours or days later. CAFE, the 
Computer-Aided Film Editor system developed at M.I.T. Lincoln 

Laboratory, allows a movie-maker to define and edit a film 

2 6 
from an on-line typewriter. His interaction, however, is 

not graphical--he cannot sketch pictures and he too must wait 
hours or days to see the film. 

Some workers using digital computers have made minimal 
changes to existing programming languages, such as FORTRAN, 
in order to attain more quickly the capacity for movie genera- 
tion. (*T) In other instances a language has been designed 
expressly for animation, as was done in providing Bell Tele- 
phone Laboratories movie-makers with BEFLIX, the first true 
animation programming language. ' Users of both augmented 
FORTRAN and of BEFLIX can in principle write arbitrary algo- 
rithmic descriptions of dynamic pictures. Still a third 

approach is that of CAFE, which is a package of commands, a 

P f\ 
control language. A limited number of useful algorithms 

are embedded in the interpretation of the commands. This 

special-purpose graphics system lacks the ability to accept 

and interpret algorithms expressed in a programming language. 

(*8) 
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The ability to define pictures "by giving formal generative 
descriptions has enabled many programmers, scientists, and 

engineers to produce animated films. That many such indivi- 

27 
duals can now become animators is an attractive result. 

Very few artists, however, have attempted computer animation. 
(*9) To use BEFLIX or CAFE, an animator trained only in 
traditional media and techniques is forced to learn a com- 
pletely new "language," a completely new way of thinking. (*10) 
Stan Vanderbeek, a creative and inventive film-maker who has 
experimented with many media, claims that it took him nearly 
two years to attain real fluency in the use of BEFLIX. ( *11 ) 
This must imply that BEFLIX, although a significant and pace- 
setting contribution, fails (for Vanderbeek, at least) to 
transform the raw computer into an effective, responsive, 
animation-machine and animation medium. I claim that failure 
is likely a priori, for some direct graphical interaction is 
a prerequisite for achieving this transformation. (*12) 
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Analog and Hybrid Computer Systems 

Two other groups achieve varieties of direct graphical 
communication with very different equipment configurations, 
hybrid and analog computer systems. 

n D 

In a 19oT paper, Miura, Iwata, and Tsuda report: 

We have recently developed two computing methods 
for producing animation: (l) Representing the picture 
in mathematical equations and moving it by switching 
the constants of the equations (analog computer method): 
and (2) having two frames drawn by an animator. The 
curve indicating the movement between these two frames 
is then read into the computer. According to the re- 
sults calculated by the computer, animations between 
the two frames are machine drawn (hybrid computer 
method ) . ... 



This method [the analog computer method] has the 
advantage that the pictures produced on the cathode ray 
tube can be moved on real time. However, the method 
also has two important drawbacks. One is the fact that 
it is difficult to produce a picture which is faithful 
to the artist's intention. The second drawback is that 
in order to obtain complicated pictures the computing 
circuit itself will become complicated. 

Furthermore, they note that the constants in the analog 

computer method may be varied "either manually or under the 

program control of the digital computer." Yet no techniques 

for generating and modifying these variations are described. 

Setting the constants individually in each frame is not a 

viable method. 

In their hybrid computer solution for interpolation; the 

animator must decompose all sketches into curved segments. 

He must define, for each segment, the original curve, the 

curve after it has been moved or modified, corresponding 
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sequence of representative points along each curve, and paths 
of interpolation for the two endpoints of the segment. In a 
variation on the technique, the final curve need not he speci- 
fied. A combination of translation, rotation, expansion, and 
contraction is employed by the computer to carry out an inter- 
polation of the representative points. The solution, although 
the only one published to date, is far from ideal. The 
decomposition into segments and the identification of corres- 
ponding points will be time-consuming and frustrating for an 
animator, especially since the choice of segments and points 
must be based on geometrical qualities of the curves and not 
on symbolic relationships among picture parts. Furthermore, 
no mention is made of the problem of hidden lines, or occlusion 
of picture parts. 

Lee Harrison of Computer Image Corporation in Denver has 
designed and built a hybrid computer specifically for anima- 
tion. The system, not yet described in the published 
literature, Is novel and innovative. Movies with texture 
may be viewed in real time. Hardware techniques solve a 
useful special-case of the hidden line problem. All Images 
must be synthesized by literally wiring a plugboard to model 
a stick figure, and then modulating the frequency, length, 
and intensity of a vector that spins rapidly around each 
stick. The result is an interesting shimmering, filmy quality, 
and so Computer Image terms the process "synthesizing skin." 
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Harrison is an artist as well as engineer, and has con- 
ceptualized and developed his machine over a span of years. 
Sample experimental films, many produced in a single night's 
work, are vivid proof of his control over his medium, and 
constitute the most exciting computer animation produced to 
date. Yet I question whether many animators will find as 
natural and useful the enforced modeling of pictures through 
stick figures and rotating vectors. Wiring a model on a 
plugboard is archaic in this age, hut was quick and economi- 
cal in the early stages of their work. They are planning to 
introduce a small digital computer to assume this and other 
functions. From what I have seen and heard described, they 
still need better techniques for describing and controlling 
the temporal behavior of the parameters of the rotating vectors. 

These analog and hybrid systems allow direct graphical 
interaction, but lack fundamental and I feel essential capabil- 
ities usually found only in large scale digital computers. 
What is missing is the capacity for flexible storage and 
retrieval of numerous images and dynamic descriptions, and 
the ability to define arbitrary formal and analytic picture 
generators where appropriate. All but the hybrid approach 
of Miura, et al , force the animator to build pictures out of 
a very limited set of analog picture generators. We do not 
yet know if there exists such a set of generators from which 
a sizeable portion of interesting pictures can easily be syn- 
thesized and modeled. Any picture can be built from points, 
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or circles under affine transformations, or vectors rotating 
about stick figures, "but the construction may be awkward and 
the representation inelegant. The hierarchic picture descrip- 
tion capability of suitably programmed digital computers 
enables a flexible and powerful solution to this problem, for 
it is in principle easier to rewrite a program than it is to 
rewire a machine. Until we obtain a better understanding of 
the descriptive capability of limited picture models, experi- 
mentation with general-purpose digital computers would appear 
useful and essential. After we possess such understanding, 
special-purpose digital and analog hardware should be added, 
and the digital computer can evolve towards a truly useful 
and economical animation-machine. 
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This Dissertation 

I have attempted to develop a process that augment s 
harmoniously the techniques with which most animators are 
familiar, that reflects and extends the ways of thinking to 
which they are accustomed. The animator can sketch with a 
stylus on a horizontal tablet. (*13) What he draws appears 
immediately on a CRT display scope above the t ablet .( *1 h ) 
Both static images and complete movies may be viewed directly 
on the scope. 

An operational system (GENESYS) allows the animator, as 
soon as he lifts the pen, to sketch frames or components of 
frames. Within this same intuitive "language" of sketching 
and mimicking, he can also synthesize picture dynamics, 
that is, descriptions of movement and rhythm. The techniques 
at his disposal are unlike those found in any traditional 
animation medium or existent computer animation system. Part 
I of the dissertation presents the concepts that are the 
heart of this approach. 

The skilled computer-animator should also be able to grow 
and modify his own animation-machine. This will be possible 
once the concepts developed in Part II of the dissertation are 
embodied in an operational system. The animator will then 
have the power to define algorithms that extend the basic 
set of system commands, that augment the basic pictorial con- 
structs and operators. He will himself design and add 



-3 0- 



mechanisms that synthes i ze and aid the synthesis of dynamic 
di spl ay s . 

To summarize, the dissertation seeks to: 

In Part I , 

(1) describe the role of direct graphical interaction, 
sketching, and mimicking in computer animation, 
resulting in the process we shall call int er act ive 
computer-mediated animation ; and, 

(2) develop a new approach to the specification of 
picture dynamics, one which exploits the capacity 
for direct graphical interaction, and which we shall 
call p i ctur e-driven animation ; and, 

In Part II , 

(3) "based on the principles evolved in (l) and (?), out- 
line the design of a multi-purpose, open-ended, 
interactive animation programming system. 

These goals are currently best met in the standard interactive 

computer graphics environment, a general-purpose digital 

computer, buffered by hierarchies of auxiliary storage, and 

augmented by hardware for directly displaying pictures and 

for accepting real time drawn input. 

The thesis of the dissertation is that: 

(1) Direct graphical interaction is a flexible and 
powerful aid to the construction of animated visual 
displays; interactive computer-mediated animation 
is feasible and deserves further research. 

(2) Picture-driven animation is a simple yet powerful, 
intuitively suggestive process with which to express 
animated displays, one which successfully exploits 
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the availability of direct graphical interaction; 
the important feature of this process is that it 
enables an animator to define and refine picture 
dynamics, movement and rhythm, through sketching, 
mimicking, and graphically manipulating static and 
dynamic images. 
(3) The progression from the ability to sketch, through 
the ability directly to command the computer to aid 
sketching and the modification of sketches, to the 
ability to extend the capabilities of the animation- 
machine and the characteristics of the animation 
medium, is natural both for the growth of the system 
and for the learning experience of the non-program- 
ming animator, The last stage of the progression 
requires an animation programming language which is 
a multi-purpose, open-ended, picture description 
language . ( *1 5 ) 
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A NOTE TO THE BUSY READER (*l6) 



If you are interested in computer animation, 

(1) Read the Table of Contents, the Introduction, and 
Chapter I. A. 

(2) Skim quickly I.B. through I.E., then reread what 
interests you . 

(3) Read I.E., and as far into Part II as you have 
time and interest. 

(if you have no technical training In computers 
and programming languages, you should he able to 
read through I.E., but it will be difficult to 
go much further. ) 

(k) Alternatively, obtain and read a copy of my 

condensation of Part 1.30 Then return to the 
di s s ert at i on . 



If you are interested in on-line systems and languages 
for computer graphics, or in extensible languages, 

(1) Execute Step 1 above. 

(2) Read quickly Chapter I.E., then skip or skim 
I.C. through I.E. 

(3) Begin reading carefully at I.E. 
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FOOTNOTES -- Introduction 



(*l) McLaren has been termed "a highly individual artist, 
..., a research worker in film techniques" (Halas and 
Manveli, 2 p. 290), "a craftsman and an innovator" 
(Stephenson, 3 p. 73). His work is described in Halas 
and Manvell, 2 pp. 290-2, 301-3, and in Stephenson, 3 
pp. 69-73. 

(*2) I.B.I contains a brief discussion of aspects of tradi- 
tional animation. For a fuller account, see References 
2 and 3. 

(*3) Some interesting speculations on uses of the computer 
in animation and sculpture appear in Sutro's^ early 
paper (1962). 

(*U) Reference 8 through Reference 13 are to recent confer- 
ences, either devoted partially or exclusively to 
computer animation. 

(*5) The phrase in real time , as it is used in the disserta- 
tion, is defined in context in I. A. 2, (3) and (k). 

(*6) In the "real world," economic constraints play a role 

in the decision. Fortunately, we have been able in the 
dissertation to ignore questions of current economic 
viability. This is fitting, for in the computer field 
what is expensive today may literally be cheap tomorrow. 

(*7) The desire to proceed with the movie-making partially 
explains the dearth, since BEFLIX, of fundamental re- 
search on multi-purpose programming languages for anima- 
tion. 

(*8) In II. A. 1 and II. A. 2 there is a detailed analysis of 
BEFLIX and CAFE viewed as languages. 

(*9) Reichardt, 25 p. 71. 

(*10) Traditional media and techniques include sketching with 
pen and ink on sheets of celluloid and superimposing 
them on an animation stand (eel animation), and position- 
ing and moving cut paper on an animation stand. In either 
case the resulting Image is photographed with a camera 
mounted on the stand; then construction of the next 
frame begins. Still another method is pixillation, in 
which the passage of time is artificially accelerated by 
shooting with a standard movie camera individual frames 
of live action, spaced at large intervals ranging from 
seconds to days. See also I.B.I, and Reference 2 and 3. 
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(*ll) This comment was made by Vanderbeek after a recent 
(late 1968) lecture and film-showing at the Harvard 
Carpenter Center for the Visual Arts. 

(*12) We shall return in III.B to the question of how much 
direct graphical interaction is required. A related 
question is how much direct graphical interaction one 
can afford. Cost, in terms of the kind of films that 
are made at Bell Laboratories and Lincoln Laboratory, 
is one major reason that BEFLIX and CAFE are graphically 
off-line . 

(*13) See I. A. 2, (3). The stylus is in fact a sheathed ball- 
point pen, with a wire connecting it to the computer. 
The tablet is covered by a glass plate, on which paper 
may be placed if so desired, 

(*lU) Cathode Ray Tube. See I . A . 2 , ( k ) . Figures I. A. 11-13 
depict the scope, stylus, and tablet. 

(*15) Throughout the writing of Part II, we adopt the ideal 
and convenient fiction that the animator himself will 
master the language described there. The thesis does 
not stand or fall on this shaky hypothesis. The ani- 
mator may always need a programmer to write and debug 
precise statements of algorithms. Nonetheless, the 
language should be a communications medium for the two 
of them. The animator should gradually become able to 
use the language informally and to comprehend roughly 
the meaning of programs. For, as we shall stress often, 
the artist who wishes to exploit fully the capabilities 
of the computer medium must in some sense understand 
its unique feature, the ability to execute with ease 
algorithms specified in some language. It is part of 
the thesis of the dissertation that the language 
developed in Part II is well conceived to achieve this 
more limited goal. 

(*l6) We are indebted to Adolfo Guzman for the concept of the 
busy reader. Guzman, p. lh . 
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I. A. INTERACTIVE COMPUTER-MEDIATED ANIMATION 



One thing only is needed for the pictorial narrator— a 
knowledge of physiognomies and human expression. After all, 
he must create a convincing hero and characterize the people 
he comes into contact with; he must convey their reaction and 
let the story unfold in terms of readable expressions. Does 
this not need a skilled artist who has spent years drawing 
from plaster casts, who has drawn those eyes, ears, noses 
which, as Topffer says [the humorist and draughtsman Rudolph 
Topffer of Geneva, in a pamphlet on physiognomies published 
in 181+5], are the pleasant exercises which art schools impose 
on budding artists? For Topffer all this is waste of time. 
The practical physiognomies needed for a picture story could 
be learned by a recluse who never sets eyes on any human 
being. All he needs is drawing material and some perseverance. 
For any drawing of a human face, however inept, however 
childish, possesses, by the very fact that it has been drawn, 
a character and an expression. This being so, and being 
quite independent of knowledge and of art, anybody who wants 
to try should be able to find out the traits in which this 
expression resides. All he must do is to vary his scrawl 
systematically . If his first mannikin looks stupid and smug, 
another with his eyes a little closer to the nose may look 
less so. By a simple reshuffle of these primitive traits, 
our lonely hermit will find out how these elements and their 
combinations affect him and us. Thus a little experimenta- 
tion with noses or mouths will teach us the elementary 
symptoms, and from here we can proceed, simply by doodling, 
to create characters. . . . 

Topffer' s method— to "doodle and watch what happens"-- 
has indeed become one of the acknowledged means of extending 
the language of art . 

E. H. Gombrich 

Art and Illusion , pp. 339-3^0,35^ 

(Emphas is added ) 
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I.A.I. THE ROLE OF DIRECT GRAPHICAL INTERACTION IN 
THE SYNTHESIS OF ANIMATED VISUAL DISPLAYS 



This dissertation is a study of ways in which man aided 
by a computer may synthesize animated visual displays. It 
assumes that the animator and the computer will he working 
in the kind of interactive context that is by now well known 
and whose utility in computer graphics is well appreciated. 

Work in fields as diverse as the design of large sculptured 

32 
shapes like airplanes and automobiles, the layout of inte- 

33 3i+ 

grated circuit masks, textile designing and weaving, 

35 
mathematical graph theory, and the debugging of computer 

programs, has established the fact that on-line graphical 

interaction facilitates man-machine communication about still 

pictures. { *1 ) This research explores the role of direct 

graphical interaction in the construction of motion pictures. 

On the basis of experience with static pictures, four 

favorable aspects of the role of interaction in computer 

graphics may be distinguished: 

(1) The availability of immediate visual feedback of 
results, final or intermediate; 

(2) The ability to factor picture construction into 
stages, and to view the result after each stage; 

(3) The ability to designate commands and pictures 
directly and naturally, anytime during the course 
of picture construction; and, 

(h) The ability to sketch pictures directly into the 

c omput er . 
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Furthermore, we have seen that the computer simulates 
not only a passive recording agent in its ability to retain 
images, but an active medium which transforms the very nature 
of the sketching process. It can help in the imposition of 
structure onto pictures and in the transformation of simple 
drawings into more complex ones, sloppy sketches into precise 
ones. 

Analogous statements on the role of direct interaction 
apply in the domain of the computer graphics of dynamic dis- 
plays. 

The power of immediate visual feedback in animation is 
striking. The computer calculates, from its representation 
of a dynamic sequence, the individual frames of the corres- 
ponding "movie." Like a video tape recorder, it plays it 
back for direct evaluation. A small change may be made, the 
sequence recalculated, and the result viewed again. The 
cycle of designation of commands and sketching by the animator, 
followed by calculation and playback by the computer, is 
repeated until a suitable result is achieved. The time to 
go once around the feedback loop is reduced to a few seconds 
or minutes. In most traditional and co mp uter animation environ- 
ments, the time is a few hours or days. The difference is 
significant, for now the animator can see and not merely 
imagine the result of varying the movement and the rhythm of 
a dynamic display . Thus he will be led to perfect that aspect 
of animation that is its core: control of the changing spatial 
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and temporal relationships of graphic information. 

Factoring the construction of an animation sequence 
facilitates the effective use of feedback from early stages 
to guide work in later stages. Working on individual small 
subsequences helps overcome the serious practical problems 
of computer time and space, difficulties documented in 
Chapter III.B., that could disallow rapid enough calculation 
and playback. One goal of this research is a conceptual 
structure that facilitates factorization in time, through the 
definition of individual frames and of consecutive subse- 
quences, and factorization in space, through the definition 
of parallel strands of dynamic activity that exist concurrently. 
Modularity, where possible, is as much a part of good animation 
practice as it is a part of good programming practice. 
Several stages in the construction of two animation sequences 
are depicted and discussed in Figures I. A. 1-10. 

Through direct control over the computer one commands 
the various aspects of construction and playback. The prob- 
lems here are somewhat more difficult than they are in the 
domain of the computer graphics of still pictures. (*2) 
One goal of the language design of Part II is that the con- 
trol features of an interactive graphics system be flexible 
and adaptable. The language allows the user to define his 
own conventions of int erac t ion--what each action of his is 
to mean and what the visible response from the computer is 
to be . 
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There are at least two distinct roles for direct sketch- 
ing in the production of dynamic displays. As in traditional 
animation, a sequence of drawings may be constructed as 
constituents of individual frames of the movie, as static 
images existing at single instants of time. If this were 
all that were possible, then picture change that extends over 
entire intervals of time could only he synthesized as a suc- 
cession of individual (temporally) local changes that alter 
one frame into the other. 

The dissertation goes further, for it explains how the 
computer can be a medium which transforms the very nature 
of the process of defining picture change , of defining move- 
ment and rhythm. Dynamic behavior is abstracted by descriptions 
of extended picture change . These descriptions may themselves 
be represented, synthesized, and manipulated through pictures, 
both static and dynamic. The animator can then define a 
stream of images with the same facility as he can construct 
a few simple still or changing pictures, for these pictures 
both generate and represent that stream of images. Each 
picture affects all images of the sequence. This means that 
dynamic control can be exercised globally over the entire 
sequence. The result is one new conception of what it means 
to draw an animated film. 
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Figure 
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Conference . 



s I.A.1-J+ are successive stages in the construction of a 
n depicting a dog dashing to his dinner and then dining, 
rames from each movement are shown superimposed, 
r details may be found in R. M. Baecker, Picture-Driven 
ion , Proceedings of the 19^9 Spring Joint Computer 



(1) A static dog glides towards a bowl. The sketches are by 
Mrs. Nancy Johnson of Waltham, Massachusetts. 

(2) Leg motion has been introduced. Now the dog hops to the 
bowl . 

Figures I. A. 1-2 
A SHORT CARTOON STAGES ONE AND TWO 
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(3) 




u; 



(3) Eager for dinner, the dog wags his tail. 

(h) Slurp goes his tongue, lapping up the milk. 

None of these intermediate stages need be transferred to film. 
Each can be evaluated directly at the interactive animation 
console, and film used only when the movie is complete. 

Figures I , A . 3-U 
A SHORT CARTOON STAGES THREE AND FOUR 
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One movie may easily 
"be transformed into 
another. The result 
of the first working 
session was this 
happy, hopping 
crocodiless . Frames 
spaced at uniform 
intervals in time 
are shown top to 
bottom, left to 
right. The 
sketches are by 
Miss Barbara Koppel 
of Chicago, 
Illinois . 
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Figures I. A. 5-6 
A CAVORTING CROCODILESS 
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Then we decided to 
alter the theme of 
the movie. At the 
second working 
session, we shifted 
spatially the 
original movement 
(with one command 
to the system, a 
good illustration of 
global control over 
an entire sequence). 
We then added the 
crocodiless' mate, 
and caused him to 
respond as is shown 
on the following 
page. 

The initial frames 
of the new movie 
appear here; the 
concluding frames 
appear on the next 
page . 
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Figures I.A.T-8 
TWO CAVORTING CROCODILES THE BEGINNING 
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Interact ive 
computer-mediated 
animation derives 
much of its power 
from the ease and 
fluidity with 
which such trans- 
formations of one 
dynamic sequence 
into another may 
be executed and 
evaluat ed . 
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Figures I. A. 9-10 
TWO CAVORTING CROCODILES THE END 
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I. A. 2. THE COMPONENTS REQUIRED TO REALIZE AN 

INTERACTIVE COMPUTER-MEDIATED ANIMATION SYSTEM 

Interactive computer-mediated animation is the process 
of constructing animated visual displays using a system con- 
taining, in one form or another, at least the following eight 
component s : 

Hardware : 

(1) A general-purpose digital computer. 

(2) A hierarchy of auxiliary storage. This is listed 
separately to emphasize the large quantities of storage 
required for the data structures from which an animation 
sequence is derived and for the visual images of which 
it Is c ompo s e d . 

(3) An input device such as a light pen, tablet plus 
stylus, ■ or wand, J which allows direct drawing to 
the computer in at least two spatial dimensions, (*3) 

The operating environment must, upon user demand, provide 
at least brief intervals during which the sketch may be 
made in real time . This means that the animator must be 
able to draw a picture without any interruption from 
the system. Furthermore, the computer must record the 
"essential temporal information" from the act of sketch- 
ing. Sampling the state of the stylus 2k times r>er 
second often suffices for our purpose. 
(h) An output device, such as a standard computer display 

scope or a suitably modified TV monitor, which allows the 
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direct viewing of animated displays in real time . (*U) 
Playback at 12 or 2h frames per second is usually re- 
quired. This feature is essential to enable the inter- 
active editing of animation subsequences. The final 
transmission of a "movie" to the medium of photographic 
film or video tape can but need not use the same 
mechani sms . 

Software : 

(5) A "language" for the construction and manipulation of 
st at i c pi ctur es . 

(6) A "language" for the representation and specification 
of picture change and the dynamics of picture change. 
We shall introduce in this work methods of specifying 
dynamics not possible with traditional animation media 
and not yet attempted in the brief history of computer 
animat ion . 

(7) A set of programs that transform the specifications of 
picture structure and picture dynamics into a sequence 
of visual images. 

(8) A set of programs that stores into and retrieves from 
auxiliary memory this sequence of visual images, and 
facilitates both its real time playback for immediate 
viewing and its transmission to and from permanent 
recording media. 
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This is a typical interactive computer-mediated animation 
console. The author is sketching with the stylus on the tablet. 
There is a CRT for viewing dynamic displays, a storage scope 
above it, a typewriter, knobs, toggle switches, and a telephone 
so that the animator may summon help. 



Figure I . A. 11 
AN INTERACTIVE ANIMATION CONSOLE 
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Interactive computer-mediated animation is often a group activ- 
ity. Suppose, for example, that an educator, an animator, and 
a programmer collaborate on an educational film. They can 
together propose, evaluate, and modify nev ideas in a highly 
fluid manner. They view the visual consequences of each sugges- 
tion directly at the console, without the time delay or expense 
of transferring it to photographic film. 



Figure I. A. 12 
DISCUSSION OF A MOVIE UNDER CONSTRUCTION 
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Atove is a block diagram of a minimal system for interactive 
computer-mediated animation. The parenthesized numbers refer 
to the system components defined in the dissertation. 



Figure I. A. 13 
AN INTERACTIVE ANIMATION SYSTEM A BLOCK DIAGRAM 
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I. A. 3. A SCENARIO ILLUSTRATING THE USE OF AN 

INTERACTIVE COMPUTER-MEDIATED ANIMATION SYSTEM 



To illustrate the process of animation in an interactive 
computer graphics environment, we present a scenario. The 
example could "be executed with the GENEr al i z ed- c el anima- 
tion SYStern, a picture-driven animation system implemented 
on the M.I.T. Lincoln Laboratory TX-2 computer. All capa- 
bilities purported to GENESYS are operational or could he made 
so with minor additions. The written form of the interactive 
dialogue has been adjusted to increase its clarity. 

We want to see a dynamic sequence with two characters 
that are simple abstract figures, a wedge and a block . The 
wedge is usually triangular, the block rectangular. The 
wedge bounces in, goes sproing on top of the block and 
bounces away. The block quivers and quickly recovers. After 
a slight delay, the wedge returns, this time coming from the 
opposite direction, and pounces again. Now recovery Is more 
difficult; the block's reverberations die out more slowly. 
On the third attempt, however, the "block enlarges and then 
devours the wedge. 

How we do it : 

ANIMATOR(A): CALL GENESYS; 

GENESYS(G): HELLO , GEMESVS AWAITS YOUR CREATION; 

[GENESYS either types this response, or displays it in 

an area of the scope designated for messages and instructions 

from the system to the animator.] 
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A: FORMMOt/IE SFROINGBQINGZAP ; 

[The animator either types the command name ' F0RMM01/I E , ' 
hits a corresponding light-button with the stylus, or writes 
an abbreviation of the command name to a character recog- 
nizer. 58 (*5) He then types a movie name, ' SPROIKGBOI WGZAP ' . ] 

G: FRESH; 

[No such movie exists in the animator's directory. 
Therefore, the command means that work begins on a totally 
new one . ( *6 ) ] 

A: fOMBACKGROUhlV; 

[A. wants to define a subpicture that will he visible 
in all frames of the sequence.] 

G: SKETCH U , MAW; 

A: 

[A. sketches a background of two scowling clouds and a 
smiling sun, drawing with the stylus on the tablet. What he 
draws appears immediately on the display scope. He indicates 
that he is through by giving a termination signal, such as 
lifting the pen high above the tablet.] 

G: OK} 

A: FORMCEl l In tko. cla** P. WEDGE; 



[The wedge, in its various instantaneous sizes and shapes, 
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is to "be represented by a unique set of sutpictures , called 
a c e l class . He sketches one version of the wedge as a 
unique suhpicture, or eel , in the eel class P. WEDGE. 



He then sketches a square as a unique eel in the class named 
'P. BLOCK.' Now the wedge and the block, unmoving, appear on 
the scope along with the clouds and the sun. ] 



A: SKETCHPCURVE P. WEDGE; 



[A. sketches the path of the desired motion of the wedge, 
mimicking the movement with the action of his stylus. 
Bounc e ... bounce ... sproing ... boun c ebounc ebounce goes his hand. 
The act of mimicking a continuous movement is called a p-curve . 
A visible, growing trail of symbols mirrors the motion of 
the stylus. The resulting trail is later removed from the 
display . ] 



A: PLAYBACK; 

[Playback the current version of the movie. Bounce... 
bounce ... sproing ... bounc ebouncebounc e goes the rigid wedge 
across the s cope . ] 
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A: EP7TFRAME Ul; 



[Assume that the wedge strikes the block in framed. 
Viewing the sequence in slow motion, A. notices that the 
wedge appears to overlap the block in a way that destroys 
the illusion of its striking and rebounding. Since only its 
location in frame 1+1 in incorrect, he alters the vertical 
position in that frame by using a knob ( shaft -enco der ) under 
the scope.] 



A: PLAYBACK; 

[With that adjustment made, the wedge's first movement 
is found to be satisfactory.] 



A: FORMCEL 2 In the clan P. BLOCK; 



[A. sketches the block in another shape, that is, he 
defines the second eel in the class P. BLOCK. This is followed 
by several more shapes and sizes. The images are ones that 
the animator thinks will be useful in synthesizing the reaction 
of the block to the blow from the wedge. Each depicts the 
block somewhat flattened, now more or less rectangular, and 
with ripples in its top surface that will be combined into a 
'boinggg. ' ] 



-55- 



A: TypESELECTJOHSFKOti P. BLOCK; 



[He types in a sequence of integers, each of which 
designates a choice of one of the drawings of the block. 
Each succeeding choice selects the eel to he displayed in 
the next frame. Of course only one state of the block is 
visible in a frame, when played back.] 



A: PLAYBACK; 

[Now the block is squashed and then quivers in response 

to the blow from the wedge. The total sequence is 

bounce. . .bounce. . .sproing. . .bouncebouncebounce. . . 
boinggg 



Further refinements to the quivering are made. These include 
the resketching of one eel, and alterations of the sequence 
and rhythm of transitions among eels. The effect of each 
modification is immediately viewed by calling PLAYBACK.] 



A: REPEATD/NAMZCPATTERNOF P. WEDGE; 

[This appends a copy of the dynamics of the wedge's 
bouncing motion to its existing dynamics, thus causing the 
movement to be repeated. Since only one eel representing 
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the vedge has been introduced, its dynamics are generated 
solely by t r ans lat ional motion. 



He similarly causes the reverberation of the block to be 
repeated. In this case the dynamics are generated solely by 



sequences of eel selections.] 



A: TAPRHVTHM BOINGINTERVALS ; 



[The block's second reaction should consist of several 
distinct reverberations, each delayed somewhat in time from 
the last. A. can feel or intuit the rhythm of the desired 
successive movements better than he can rationalize it. Hence 
he goes tap... tap tap tap on a push-button. 



Using techniques ve shall not detail here, he isolates the 
pattern of block selections which yields a single reverbera- 
tion, and repeats it at intervals determined by the tapped 
rhythm. ] 



-57- 



A: PLAYBACK; 

[Now the action is 

bounce. . .bounce. . .sproing. . . bounc ebouncebounc e . . . 
boinggg 

. . .bounce. . .bounce. . .sproing. . .bouncebounceb ounce 

boinggg boinggg boinggg. 

boinggg. . . ] 



A: EVITVVNAM1CS; 

[GENESYS produces a display, arranged on a common hori- 
zontal axis which represents movie time clocked in frames, of 
the changes with time of the selection sequences and the X 
and Y coordinates of the wedge and the block. (*T) There 
are then available a variety of editing commands for operating 
upon these graphs and thereby changing the movements they 
represent. For example, the animator decides that more speed 
and acceleration in the second hopping movement would better 
portray the wedge's mi s ch ievousnes s . He also recalls he 
intended that this motion be from left to right, opposite in 
direction from the first one. Hence his first command negates 
the section of the X waveform of the wedge which defines the 
second movement. He then latches on to this section of the 
curve with his pen, and compresses it horizontally. This has 
the effect of speeding up the motion. Finally, he resketches 
part of the waveform so that there is more acceleration in 
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one part of the movement. He also edits somewhat the selec- 
tion sequences of the block, adding some variety in the suc- 
cessive reverberations.] 



A: PLAVBACK; 



[The final task is to construct the wedge's third attack 
and its unhappy end. Mew eels for both the wedge and the 
block are constructed. A variety of techniques may be used, 
again including the mimicking of new continuous movements and 
the alteration of existing ones, the definition of new selec- 
tion sequences, and some fine adjustments on individual 
critical frames.] 



A: PLAYBACK; 

[Thus, the final sequence is 

bounce. . .bounce. . .sproing. . . bounc eboun cebounc e . 
boinggg 



. . .bounce, .bounce, .sproinggg. . bounc eboun cebounc e 

boinggggg boinggg....boingg. 



bounce, .bounce, . suroin 

iboing 2 g A PIN] 



A: SAVE SPROINGBOINGZAP; 

[The movie is saved under the name 'SPROINGBOINGZAP,' and 
is available for playback or further refinement at any time.] 

G: SPROINGBOINGZAP IS SAVEV; GQQV BV£ . 
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I.A.1+. IMPLICATIONS OF THE SCENARIO 

(1) Approximately 200 frames are generated from fever than 

20 eels. These eels may "be constructed with very limited 
tools, specifically, programs that accept direct sketches 
and that enable selective erasure of picture parts. 
Nonetheless, great power results from the animator's 
ability to control and evaluate dynamic combinations of 
a few static images. 

(2) Immediate playback encourages t r ial-and-error experimen- 
tation to achieve desired visual effects. 

(3) A variety of static images, analytical graphs of picture 
action, depict the time dependence of dynamic picture 
parameters. An example is the waveform representing the 
wedge's changing horizontal position. Viewing such 
static representations aids the understanding of exist- 
ing animation sequences; resketching or editing them 
changes the actual dynamic behavior accordingly. 

(k) The animator may in real time mimic aspects of dynamic 
behavior. His movement and rhythm are recorded by the 
system for application in the movie. This occurs when 
the bouncing of his stylus motion is used to drive the 
wedge, and when the tapping of a push-button Is used to 
determine the rhythm of the recurring reverberations of 
the block. 

(5) Three aspects of dynamic behavior appear in the example: 
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path descriptions , or potentially continuous coordinate 

change s ; 
selection descriptions , or recurring choices of eels 

from a eel class; and, 
rhythm descriptions , or temporal patterns marking events. 
The pictures (3) and actions ( M , through which direct 
control over dynamics is exercised, are representations 
of these three kinds of global descriptions of dynamics. 
(6) Global operations ( 3 ) - ( h ) , which alter dynamic behavior 
over entire intervals of time, may be supplemented where 
necessary by local operations, which adjust individual 
frames. An example is the positioning of the wedge with 
respect to the block at the moment of impact. 
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FOOTNOTES -- I. A. 

(*l) Primarily for the benefit of readers not trained in 
computer science, here are numerous references to 
articles on interactive computing and computer graphics: 
The historical roots are found in the classic papers of 
Bush 3 ? and Licklider.38 lm E . Sutherland's SKETCHPAD, 
still fundamental to workers in the field, was the first 
interactive computer graphics system of significant 
generality . 39 A readable introduction to computers, 
methods of man-machine communication, and various appli- 
cations is a recent issue of Scientific American. 40 
The most enthusiastic and spirited descriptions of the 
potential of interactive computing are those by 
Li cklider . 1 » ^2 There are many current survey papers, 
including one in each Annual Review of Information 
Science and Technology that reports on and refers to 
yearly progress. ^3-^7 Also of considerable interest 
are a 1966 paper on ten major unsolved problems of 
computer graphics (most still essentially unsolved, 
many relevant to achieving economically viable computer 
animation)/ 4 " an article stressing hardware-software 
trade-offs in the design of computer graphics systems, 4 " 
and more-or-less detailed descriptions of available 
display har dwar e . 5 , 51 Finally, a recent book surveys 
the entire field of information display, including 
photometry, c olor imetry , image analysis, optics, record- 
ing media, cathode-ray devices, film-based projection 
systems, light valves, lasers, electroluminescent devices, 
and laser holography, and lists extensive references to 
each of these topics. 52 ^he use in movie-making of 
technologies other than film and cathode-ray devices 
should soon be explored. 

(*2) Not only the "resulf'of a user action, that is the 

sequence of designated commands and data, but also the 
dynamics of the action, must be properly recorded and 
interpreted by the system. Furthermore, extended user 
actions may exist concurrently with extended system 
actions, such as the dynamic display of a picture. 

(*3) References 53 and 5^ describe two tablets currently 

much in use. Reference 5 5 presents a device called the 
comparator, which should be added to tablet hardware 
to simulate the light-pen's role in the direct designa- 
tion of picture parts by pointing at them. The 
comparator generates an interrupt whenever the display 
beam comes close enough to the stylus position. 

(*k) Reference 57 describes a novel hardware configuration, 
potentially useful for animation, in which the display 
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is projected through the glass of the horizontal tablet. 
The TX-2 hardware, like most, has a vertical scope and 
a horizontal tablet mounted beneath it. 

(*5) Serious problems can arise in the display of a menu of 

light-buttons corresponding to available system commands, 
because the area on the scope allocated to such functions, 
in fact, the entire area of the scope, is often inade- 
quate for sets of commands large enough to be useful. 
Sophisticated layout algorithms, and paging and window- 
ing mechanisms may be devised to combat the difficulties. 
GENESYS currently employs some paging, and relegates 
many commands to typewriter control. 

(*6) A typical alternative response would indicate the length 
in frames of the existent movie named » SPROINGBOINGZAP , ' 
and the date and time of the most recent session in 
which it had been constructed or modified. 

(»7) A similar display is depicted in Figure I.B.I, in which 
the graph of a selection description appears near the 
top of the picture, and the waveform representing the 
change with time of a continuous coordinate appears near 
the bottom of the picture. 
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I.B.I. THE INDIVIDUAL CONSTRUCTION OF EACH FRAME IN 
THE SEQUENCE 

Animation sequences have traditionally been synthesized 
through the individual construction of frames, with the illu- 
sion of a continuum of time later being attained through 
rapid playback of the discrete instants of time. This 
approach is the only one possible when constructing a series 
of pictures which defy regular or formal description, and 
which require unique operations on each frame. 

Stephenson describes how the burden of drawing lU^O 
pictures for each minute of film has been lessened in commer- 
cial animation, and how this has affected both the product 

3 
and the process of animation: 

.There are various means of economising. 
By using layers of transparent celluloid, and by 
painting or drawing different parts of the scene 
on different layers, backgrounds or characters^ 
which are stationary can be used again and again, 
and only the part actually moving at the time 
(lips, fingers, eyes etc.) need be re-drawn. 
Again an arm on a separate eel can be moved by 
tilting the eel instead of redrawing. A second 
means of economy possible with slower movements, 
is to repeat the same drawing for two (even three) 
frames. This is equivalent to projection at 12 
frames a second, intervals are adjusted to corres- 
pond, and the eye accepts movement as normal or 
nearly normal. In more recent cartoons less 
realistic movement is accepted. As John Halas 
says "Now we can get away with four drawings a ^ 
second whereas once twenty-four were necessary. 

The third way of lightening the labour of 
drawing involved in the cartoon is by simplify- 
ing the style. The patient composition of the 
painter in oils or water colour, the intricate 
traceries of the pen-and-ink artist or the 
etcher, the careful building up of subtle colour 
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effects are outside the range of the cartoonist, 
pimple Ime, clear, readily-grasped colour ef- 
fects, are what the animated artist must go for 
The economy of drawing dictated by the conditions 
ot production may seem a handicap The cartoon 
will never emulate the wealth of detail which 
enriches the picture galleries of the world. But 
when we come to the conditions of viewing, the 
cartoon's simplicity is an advantage. If the 
moving cartoon were as complex as the static paint- 
ing the viewer would never be able to grasp it. A 
clear, quickly-understandable composition is 
essential . 

... (*1) 

A fou ^h method of meeting the demands of 
the cartoon medium is by organization and divi- 
sion of labour. Carl Fallberg writes in The 
American Cinematographer: "As s embly-line^7t hods 
are essential. It is technically possible for 
one^person to do everything from the first pre- 
liminary story sketches to photographing the 
finished drawings on film, but there is such an 
infinitude of detail involved that the number of 
nands doing the work simply must be multiplied." 

In e ^ery animated film-studio of any size 
the work is divided up and different people spe- 
cialize in particular jobs. In a small studio 
the workers will know each other's jobs, there may 
be an interchange of work or at any rate a reward- 
ing feeling of group effort and mutual apprecia- 
tion of each other's skills. In the large studios 
it may be more like a factory process. There are 
individual variations in different studios but 
the general procedure is as follows. Before the 
animation drawing is started there are several 
preparatory stages-story-board, work-book, lay- 
out, model sheets, soundtrack, charts, dope 
sheets. The story-board is the same as for any 
film: a series of small sketches with enough 
description to enable the plot of the film to 
be followed. The work-book is a much more 
detailed, almost photo-by-photo analysis without 
drawings, describing the action in words and 
giving dialogue or other sound to accompany each 
action; it is a kind of film script. Layout and 
model sheets are preliminary drawings to deter- 
mine the type and relative size of the characters 
and the style of the film. The soundtrack c harts 
show the music, bar by bar, related to the visuals, 
and the dope-sheets or camera exposure charts, 



schedule in more detail each single exposure. The 
film is then fully planned and the work of execu- 
tion begins . 

The following nov set to work: the back- 
ground artist, the key animator, the in-betweeners , 
the inker, the painter, the checker, the cameraman, 
and the film editor. The key-animator draws the 
key positions of each movement, the in-betweeners 
copy his work, varying it slightly to provide the 
necessary movement between one position and another. 
Then the inker blocks in the outline on the 
celluloid sheet and the painter or opaquer fills 
it in with the correct colour. Checkers ensure 
that the eels are properly lined up and matched 
and in the correct sequence for the cameraman 
who photographs the drawings. An animation 
camera and its rostrum are especially designed 
to photograph drawings or models or objects, 
photo-by-photo, frame-by-frame. 

One sequence or scene of the film will be 
completed at a time and viewed. Finally, the 
various sequences will be assembled by the editor 
and the completed film is ready for viewing. 

It is this division of labor, this dispersal of the 

h 
creative process which separates the artist from the medium. 

Another result is the continuing dramatic rise, faster than 
the GNP, of the cost of animation. In large studio opera- 
tions, salaries for producers, directors, designers, layout 

artists, studio managers, and those others named above 

2 
typically consume half of the cost of a film. 

A serious weakness of conventional frame-by-frame anima- 
tion is that there are no efficient methods of making changes 
to a movie stored on photographic film or video tape. 

On the other hand, film's high resolution and resulting 
capacity to store and convey information allows diverse kinds 
of textures and color to be reproduced. Dynamic collages of 
a variety of cut-out material, puppet animation, and McLaren's 
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technique of drawing and painting directly on film all achieve 
radically different tonal qualities. (*2) Such qualities 
are presumably difficult to preserve in computer processing. 
However, we need not try to imitate them when we instead can 
develop new and interesting styles unattainable without a 
computer, such as those created by Harrison at Computer Image 
and Vanderbeek using BEFLIX. 

Despite the computer's flexibility as a sketching and 
resketching medium, it also appears wasteful to use a large 
general-purpose digital computer merely to reproduce conven- 
tional frame-by-frame animation techniques. In this disserta- 
tion we seek ways to use creatively the great computational 
capacity of such a machine. 

With the aim of streamlining the techniques of eel and 
cut-out animation, the National Film Board of Canada has 
undertaken to control the movements of their animation stand 
with a small digital computer. 9 (*3) It will be interest- 
ing to compare and integrate the results of their approach 
with those of Computer Image and this dissertation, as all 
may contribute towards the design of a more flexible, more 
responsive animation-machine. 
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I.B.2. THE INTERPOLATION OF SEQUENCES OF FRAMES 
INTERMEDIATE TO PAIRS OF CRITICAL FRAMES 

The technique of interpolation has long been used to 
cut costs and reduce the burden of picture const ruct ion whi ch 
is placed on the key animator. Interpolation occurs when the 
key animator asks his assistants to fill in the frames inter- 
mediate to a pair of critical instances of transition. In a 
typical cartoon, for example, the key animator may himself 
sketch only the following: gasp of horror, arm cocked for 
ferocious swing, arm thrusting forward as target ducks, arm 
stretched as if made of ruhher, and arm zooming off into outer 
space . 

It has been suggested that part of the interpolation 

process could he mechanized, and we have described in the 

28 
Introduction the only published attempt to do this. We 

shall discuss Interpolation in its general formulation no 
further. Limited instances of interpolating sections of move- 
ment, however, will reappear, particularly in I.C. 
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I.E. 3. THE GENERATION OF FRAMES 

FROM AN ALGORITHMIC DESCRIPTION OF THE SEQUENCE 



The generation of a sequence of frames from a formal 
algorithmic description Is a process characterized "by: 

(1) the need to use a computer, for it is the only 
animation medium which can follow and execute with 
ease a complex algorithm; 

(2) generality, that is, applicability to a large 
class of regularly-structured pictures; 

{3) representational power, or the compactness with 

which interesting animated displays may he formu- 
lated ; and, 
(k) flexibility and adaptability, or the ease with 
which a variety of alterations may be made to a 
movie expressed as an algorithm. 
One primary source of representational power and flexibility 
is the algorithm's temporally global q.uality--it specifies 
the picture state over an entire interval of time, and not 
merely at individual frames. 

We have noted in the Introduction that, since formal 
picture descriptions are usually expressed as written pro- 
grams in a language such as BEFLIX, ' or as sequences of 

directives in a typewriter-controlled command language such 

P ft 
as CAFE, artists have found it difficult to adopt the com- 
puter as a new medium. 
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The process of picture-driven animation attempts to 
bridge the gap between traditional and computer techniques 
by exploiting direct graphical interact ion and the descrip- 
tive capability of pictures and sketches. As we shall now 
see,- the animator creates a movie by combining algorithaic 
definitions, drawings, and representations of movement and 
rhythm. 
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I.B.U. PICTURE-DRIVEN ANIMATION 

Picture-driven animation is a new process that augment s 
harmoniously the animator's traditional techniques, that re- 
flects and extends the ways of thinking to which he is 
accustomed. Within his intuitive "language" of pictures and 
sketching and mimicking, he may synthesize both components 
of frames, called eels , and generative descriptions of extended 
picture change, called global descriptions of dynamics . 

Global dynamic descriptions are data sequences, whose 
successive elements determine critical parameters in succes- 
sive frames of the movie. Algorithms embedded in a picture- 
driven animation system combine eels and dynamic descriptions 
to produce visible picture change. The animator defines and 
refines pictorial representations of dynamic descriptions. 
These data sequences then "drive" the algorithms to generate 
an animated display. Hence the process is called picture- 
driven animation. 

The process is powerful because it is easy to achieve 
rich variations in dynamic behavior by altering the data se- 
quences while holding constant a few simple controlling 
algorithms . The data sequences precisely determine the 
evolution of recurring picture change, within the constraints 
set by a choice of controlling algorithms. 

The remainder of I.B. Introduces the three kinds of 
global dynamic descriptions and some useful algorithms for 
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which they may be driving functions. I.C. describes and 

analyzes the art of defining and refining dynamic descriptions. 

We adopt the following classification; 

A global dynamic de^o-riptipn; lev; wither 

a moYeaeat ;deftcrlptdfljL » yiijjBfa ts either 

a continuous movement description - a path 
description , or 

a discrete movement description ■ a selection 
description ; or, 

a rfayt h» de sex ipt i on . 
I claim that the terminology i;S a®gm&pr%&L* * :,*&*£; these descrip- 
tions are conceptually meaningful afc^ft^aasfcUtfae: of- movement and 
rhythm, a kind of * vocabulary pax £&ma&&&:J , [ ^m yofcahuiary for 
expressing picture- change. ~- " J : - 1' 
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I.B.5. THE RELATIONSHIP, IN GENESYS, OF CELS 

AND CEL CLASSES TO GLOBAL DYNAMIC DESCRIPTIONS 

Since the following discussion relies heavily on illus- 
trations of the use of GENESYS, we now describe how it combines 
eels and global dynamic descriptions to produce dynamic dis- 
plays . 

GENESYS permits users to impose dynamic picture behavior 
independently of the definition of static picture structure. 
Static pictures are generated by the traditional techniques 
of sketching and individual construction, and may then be 
used in one of three ways: 

(1) A static picture may serve as the constant back- 
ground for an entire animation sequence, as did the 
scowling cloud and smiling sun in » SPROINGBOINGZAP . ' 

(2) A static picture may be introduced In a single 
unique frame of the final animation sequence. 
Frames totally generated in this manner have there- 
fore been defined by the approach of individual 
construction, 

(3) A static picture may be defined to be a unique 
eel . Cels are then grouped into eel classes . The 
term 'eel 1 is taken from conventional animation 
practice. We have seen that it means a sheet of 
transparent celluloid on which is painted some 
separable aspects of the picture scene, part of the 
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background (group of trees, or clouds, or a rocket- 
ship) or even the foreground (hat which is to fly 
off, garbage can which is to he kicked or sprinkled). 
Examples of two eel classes in GENESIS are the 
wedge and the block of ' SPROINGBOINGZAP » , each 
represented in various sizes and shapes. Other 
examples are a set of choices for the mouth of a 
cartoon character, and a set of striped patterns 
used to create the illusion of a revolving harber 
pole . 
Using the current system, the GENESIS animator sketches 
or otherwise defines two path descriptions and one selection 
description for each eel class. The system applies a simple 
algorithm which in each frame selects and positions one eel 
from each class according to the data in the descriptions. 

Beginning with this very special case, we shall develop 
and broaden the concept of global dynamic description, showing 
how the sequences may drive a much wider variety of algorithms, 
and thereby generate a much more interesting repertoire of 
dynamic displays. 
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I.B.6. PATH DESCRIPTIONS 

Consider those alterations of static pictures that 
consist of modifications of continuously variable parameters, 
such as location, size, and intensity. Their instantaneous 
values determine the picture's appearance at a given moment. 
Thus the static picture may be animated by specifying the 
temporal behavior of such parameters. A representation of 
the temporal behavior of a continuously variable parameter 
is called a path description . 

The movement of a fixed-geometry picture (eel) in GENESYS 
is described as the change of two coordinates with time, and 
is represented by a pair of path descriptions. Their speci- 
fication may be used to synthesize the drifting of a cloud, 
the zooming of a flying saucer, the bouncing of a ball, or 
the positioning of a pointer. 

Since the behavioral descriptions of the parameters apply 
to entire intervals of time, the animation is liberated from 
a strictly frame-by-frame synthesis. The computer is a 
medium through which one can bypass the static or temporally 
local and work directly on the dynamic or temporally global . 
Movement is represented as it is perceived, as (potentially) 
continuous flow, rather than as a series of intermediate 
st at es . 

Chapter I.C. describes how path descriptions may be 
defined by algorithm or by direct on-line construction. 
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Free hand sketching is a useful technique vhen one knows the 
general shape and quality of a motion rather than an analyti- 
cal expression for a function that determines it. Modifi- 
cations of the sketches are frequently invoked after one 
views the current animation sequence and determines how it 
is inadequate. 

There are two related kinds of pictorial representations 
of all movement descriptions, static and dynamic. 

A static representation of a single path description is 
a waveform, in which time is identified with a spatial dimen- 
sion, in common practice the horizontal. The continuous 
curve at the bottom of figure I.B.I, is a waveform depicting 
a picture parameter which increases and decreases gradually, 
then quickly oscillates between large and small. The super- 
position on a common time axis of several path descriptions, 
such as plots of the positions of fleeing and overtaking 
flying saucers, facilitates the refinement of their relative 
dynamics. In this case it provides the animator with a 
very powerful, temporally global control over the "feeling" 
of the chase scene. 

A dynamic representation of a path description is an 
animated display. (*k) The dynamic construction of a path 

description is achieved by timing the stylus's movement and 
recording its position at short, uniform intervals such as 
every 2^th of a second. A tangible representation of the 
path is the display of a sequence of symbols spaced equally 
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in time. Thus the bouncing of the wedge in ' SPROINGBOINGZAP ' 
may be synthesized by "bouncing" the stylus along some path 
on the tablet surface, that is by mimicking the desired 
dynamic behavior. 

A path description, in summary, defines dynamic activity 
that consists of potentially continuous and arbitrarily fine 
alterations of value. The reader should not be misled by the 
choice of the word "path." What is meant is a path, or 
sequence of values, through an arbitrary "continuous undimen- 
sional space," through a mathematical continuum. One applica- 
tion or interpretation of this path is the representation of 
a movement through the location-space of an object, such as 
a figure's trajectory along the floor of a room. To specify 
this trajectory, we need two paths, x(t) and y(t), that define 
the horizontal and vertical position. This application, 
although the only one operational in the current version of 
GENESYS, is not the only possible one. Depending upon the 
picture description capability of the system in which it is 
used, and the algorithm which it drives, a path description 
may determine changing locations, i ntensities, thicknesses, 
densities, or texture gradients . For example, a pulsating 
heart could be animated by varying either the size or the 
intensity of a single heart shape. I.B.10. further elaborates 

on this point. 

A pair of path descriptions may be used to represent 
the layout of a complex information display, that is, an 
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ordered sequence of locations at which components of the 
display are positioned. Here the descriptions convey the 
movement of an implicit scan of a static picture; they need 
not necessarily correspond to an actual trajectory dynamically 
traced in an animation sequence. 

There is no re quir ement that the defined movement he 
applied always to the same eel, or to only one eel. So that 
the drifting moon may smile in anticipation of a visit from 
Apollo-10, changing facial components must be superimposed; 
the facial expressions must be driven by the same path descrip- 
tions as move the moon. The GENESYS animator can accomplish 
this by making copies of the path descriptions. A more 
powerful and useful mechanism would allow the binding of the 
motion of one eel class to that of another eel class, so that 
the controlling movement is always automatically copied into, 
or added to, that of the subordinate movement. (*5) This 
technique, whether executed by the animator or automatically 
by the system, is often used to constrain various eel classes 
to move as a unit. The eels of a crocodiless, members of the 
classes 'body', 'legs', 'Jaws', and 'tail', are drawn so that 
the figure coheres as a static image. If the same paths are 
then applied to all four classes, it will not disintegrate 
while moving. 
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I.B.7. SELECTION DESCRIPTIONS (l) 

Consider the algorithm that selects an element of the 
current frame from among members of a eel class. A good 
example arises in the synthesis of different facial expres- 
sions through the abstraction of discrete shapes and posi- 
tions of mouth, nose, eyeballs, and eyebrows. One eel class 
could consist of the two members "eyebrows raised" and 
"eyebrows lowered." An animation sequence in GENESYS may be 
achieved by a temporal concatenation of selections from a eel 
class. A changing facial expression may be achieved by the 
parallel application of several such sequences of selections, 
one corresponding to each facial component. In 
' SPROINGBOINGZAP' , this technique was used to generate 
the reaction of the block to the wedge. (*6) 

A representation of the dynamic selection from a finite 
set of alternative pictures is an example of the second type 
of global dynamic description and is called a selection descrip- 
tion . It is suggestive to think of a selection description as 
a single melodic line, the notes of which are selected from a 
conventional discrete scale. The synthesis of selection de- 
scriptions is also aided by the use of pictorial representations, 
such as a graph of a sequence of steps, where the length of 
each step denotes an integer number of frames, and its height 
is a transition from one position to another on the 



-80- 



discrete scale. An example of such a picture appears at the 
top of figure I.B.I. ; the selection description it represents 
is one which chooses among four alternatives. Superposition 
on a common time axis of pictures of several descriptions 
facilitates coordinating the counterpoint of the parallel 
selection strands. 

The use of the term "selection" implies that a mechanism 
chooses from among a designated set of alternatives. In the 
example of the animation of a facial expression, the alter- 
natives are eels, images to he introduced as components of 
frames in a dynamic sequence. A natural question comes to 
mind--is it meaningful and useful in computer animation to 
consider selections from among other kinds of entities, for 
example, algorithms or numbers? The answer, as we shall see 
in I . B . 9. , is 'yes ' . 
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I.B.8. RHYTHM DESCRIPTIONS 

Rhythm descriptions consist of sequences of instants of 
display time (frames), or intervals "between frames. They 
define patterns of triggering or pacing recurring events or 
extended picture change. In this context it is suggestive 
to think of a rhythm description as a pulse train. Each 
pulse may be used to trigger the same action, or, as we shall 
soon see, it may trigger one of several activities under the 
control of a selection description. Examples of the apparent 
triggering effect of a rhythm occur when we advance the hand 
of the clock every second, cause a dancing figure to hop at 
every pulse, or produce a tremor in a house whenever smoke 
emerges from a nearby factory. In ' SPROINGBOINGZAP ' we 
generated new reverberations in the block at Intervals cor- 
responding to a tapped rhythm. 

Rhythm descriptions facilitate the achievement of 
coordination and synchrony among parallel strands of dynamic 
activity . In this context it is suggestive to think of a 
rhythm description as a sequence of event markers. The rhythm 
may be defined with respect to the actions of one eel class, 
and then used to guide the construction of another action. 
For example, the animator records the instant when the wedge 
in its third movement would hit the block, and then adjusts 
the devouring action of the block to anticipate the arrival 
of the wedge. ,He determines the set of frames in which the 
lead bird of a fleet accelerates, and uses this information 
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to generate a kind of coordinated action — each "bird flies on 
a separate path, hut all accelerate and decelerate simultan- 
eously . 

A rhythm description does not by itself define picture 
change; it defines a beat, a sequence of cues with respect 
to which picture change is temporally organized and reorganized. 
Animators have sometimes used metronomes as generators of 

rhythm descriptions. Proper synchronization of a sound track 

2 
to the visual part of a film is most critical to its success. 

In practice, much effort is expended, sometimes aided by special 

devices, to extract rhythm descriptions from a sound track in 

such a form that they can be used in animating, or in editing 

existing animation sequences. (*7) 

Hence, rhythm descriptions marking critical instants of 

time play a key role in the synthesis and editing of movement 

descriptions. For these operations a rhythm description 

requires pictorial representation. In Figure I.B.I, it is 

depicted both as a static pulse train and as a sequence of 

event markers along the axis of movie time. A direct and 

simple dynamic input, as we have seen in ' SPROINGBOINGZAP ' , 

consists of tapping out the rhythm on a push-button. 
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The continuous curve at the bottom is a waveform representing 
a path description. The discrete curve at the top represents 
a selection description that chooses among four values. The 
pulse train between them represents a rhythm description. The 
three pictures are plotted on a common horizontal axis—movie 
time measured in frames. Picture change occurring in any frame 
is therefore depicted along a single vert i cal line . The visible 
character strings are "light-buttons" which activate GENESYS 
commands, and messages to the animator. 



Figure I.B.I 
GLOBAL DYNAMIC DESCRIPTIONS 
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I.B.9. SELECTION DESCRIPTIONS (2) 
DYNAMIC HIERARCHIES 



With selection descriptions, as we have seen in I.B.7., 
the GENESIS animator chooses subpictures, or eels, from a eel 
class. A more general view regards a selection description 
as a sequence of s electors , functions which choose from a 
designated and finite yet potentially denumer able set of 
alternatives. Depending upon the picture description capabil- 
ity of the system in which it is used, and the algorithm which 
it drives, a selection description may also choose among 
alternatives that are numbers, picture-generating algorithms , 
other global dynamic descriptions, or pictorial events or 
act ivit ies . 

The dynamic selection from alternative numbers would 
occur in a system whose pictures could be displayed at one 
of eight different intensities, or whose lines could be drawn 
either solid, dotted, or dashed. The dynamic selection among 
alternative picture-generating algorithms would occur in a 
system with discrete texture choices, where there is one 
algorithm capable of filling an arbitrary region with that 
t ext ur e . 

A pictorial event is an instantaneous state of an anima- 
tion sequence, a single frame or one of its constituent sub- 
pictures. The subpicture may itself consist of several eels. 
An example is the initial instant of collision between the 
wedge and the block in ' SPROINGBOINGZAP * . A pictorial activity 
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is an extended interval of an animation sequence, or an 
extended interval of a subsequence contained within it. An 
example is the ' bounc e , boun c e , spr oing , bounc ebounc ebounc e ' of 
the wedge. A pictorial activity is sometimes called a___strand 
of dynamic activity to emphasize that there may exist other 
concurrent activities, other parallel dynamic strands. 

In a system in which selection descriptions could choose 
from sets of global dynamic descriptions, pictorial events, 
or pictorial activities, useful dynamic hierarchies could be 
established. Suppose, for example, that the animator of a 
crocodiless develops sequences of selections from the eel 
class 'jaws' that are visual representations of laughter, 
smugness, frowning, and crying. When he later wants the 
crocodiless to laugh, he refers to this pattern of selections 
as a unit and introduces it as part of a new sequence. Sup- 
pose further that a hop, a skip, and a jump of the crocodiless 
are synthesized. This is done by defining and refining two 
path descriptions and one selection description for each of 
the constituent eel classes, 'jaws', 'body', 'legs', and 
'tail'. If he then wishes to experiment with varying dynamic 
patterns of hop, skip, and jump, he defines a selection de- 
scription which chooses among these three alternative pic- 
torial activities, the sets of dynamic descriptions that form 
a hop, a skip, and a jump. 
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I.B.10. GENESYS GENERALIZED 

We have seen how a single eel class, a pair of path 
descriptions, and a selection description are used in GENESYS 
to generate a dynamic sequence. The argument has also de- 
scribed the far greater role that dynamic descriptions could 
play, if used as driving functions for a wider class of 
algorithms. This concluding section suggests how GENESYS, 
within its design philosophy, can gracefully be augmented to 
enable dynamic descriptions to play this greater role. 

Generalization l-- Proj ective Transformations of Cels : 

Currently in GENESYS, at most one member of a eel class 
is visible in a given frame. If the selection description 
assumes the value zero at that frame, no eel is visible; if 
its value is k, the k * eel is visible. The position of the 
eel is determined by a pair of path descriptions. Continuous 
rotation, a very important feature, would be possible if the 
orientation of the eel could be controlled by a third path 
description. There would then be as many degrees of freedom 
as now exist in animating by selecting and arranging paper 
cutouts and by overlaying drawings done on celluloid sheets. 

A straightforward extension of GENESYS would allow the 
animator to associate with each eel class a sequence of two- 
dimensional projective transformations, including not only 
translations and rotations but also scale changes and hori- 
zontal and vertical expansions and contractions. Parameters 
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of the transformation, for instance, a rotation angle and a 
factor of expansion, would "be assigned either a constant 
value or a sequence of values, that is, a path description. 
It would then be as easy to depict a rotating space ship 
fading into the distance as it is to show a space ship of 
fixed size and orientation zooming across the sky. 

Generalization 2-- Dynamic Hierarchies : 

I.B.9. has introduced the concept of hierarchies of 
structured dynamic behavior. Combining collections of dynamic 
descriptions for use as a unit is an economical way of achiev- 
ing a higher level of discourse. GENESIS should be augmented 
to include such a macro-capability. The user would then 
define an event or an activity by listing: the eel class 
(or group of classes) whose movement is to be saved as a 
unit; the attributes of the movement to be included, which 
may be any or all of the x path, the y path, and the selec- 
tion description; and, the frame of the event or the interval 
of frames of the activity, (*8) If arbitrary dynamic 
hierarchies are to be established, then the system must also 
allow combining defined events and activities into higher- 
level activities. 

What is desired is illustrated by the following hypo- 
thetical sequence of commands: CALL JAWS BODY LEGS TAIL the. 
CROCODILE; CALL X Y S o & CROCODILE fi/iom^iarm 25 tkfi.ough.$tLCLme. 
1+8 a HOP; APPLWP HOP tothamovQ.me.vitol CROCODILE; AVPEMV HOP 



tothzmove.me.yitoi CROCODILESS, The first command groups a 
set of existing eel classes into a unit called a 'crocodile'. 
The second command extracts the fragments of the twelve 
dynamic descriptions that make the crocodile hop. The third 
command appends a copy of the hopping motion to the croco- 
dile's existing movement. The fourth command, which assumes 
that a crocodiless has been similarly formed from four eel 
classes, causes the crocodiless to hop in the same way as did 
the crocodile. 

Generalization 3-- The Gener ali zed-Cel : 

A generalized-eel is, roughly speaking, a picture so 
defined that its appearance in a given frame of the dynamic 
display is determined "by the values of a set of associated 
movement descriptions. (*9) Cel classes as they currently 
exist in GENESYS , and eel classes under arbitrary projective 
transformations, are special kinds of generalized-eels. 

As an example of a generalized-eel, consider the follow- 
ing picture--a textured five-pointed star, whose location in 
two dimensions, orientation, and density of texture are con- 
tinuously variable, and whose edges are displayed either 
solid or dashed and in one of eight different intensities. 
Suppose that these four continuous and two discrete parameters 
may he varied throughout an interval of a dynamic sequence. 
Then an instance of the star appearing in a particular frame 
depends upon the values of four path descriptions and two 
selection descriptions. 
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The GENESYS user should "be able to commission a 
generalized-eel in the sense that he instructs a programmer 
to embed into his version of the system a special algorithm, 
one which takes a number of movement descriptions as para- 
meters and from their values in each frame computes a picture, 
This algorithm will be expressed in the language in which 
GENESYS is implemented, for one cannot write programs in the 
command language of GENESYS. GENESYS ' s design, on the other 
hand, should allow the new command to be integrated smoothly 
into the system. Specifically, it must guarantee that all 
tools available for the editing of X, Y, and selection 
descriptions are available for the editing of the new move- 
ment descriptions. 

Implementing Generalizations 1 and 3 would augment the 
class of dynamic images that can be produced with GENESYS; 
implementing Generalization 2 would only facilitate the 
production of certain sequences. 



In conclusion, we have seen that GENESYS is a picture- 
driven animation system in which a few simple controlling 
algorithms combine eels and dynamic descriptions to form 
animation sequences. The algorithms are fixed and embedded 
in the interpretation of GENESYS ' s command set. At some 
point the animator may discover that the set of available 
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algorithms restricts the class of dynamic displays that he 
can generate and modify with ease. Already in this section, 
we have proposed a concrete schemata for additions to the 
system. The animator's only current recourse is to persuade 
the programmer maintaining GENESYS to modify or augment the 
system. These additions must be made in the language with 
which GENESYS is implemented, a language unrelated to the 
command language used by the GENESYS animator. For eventual 
users of APPL, the system described in Part II, there will 
be a nicer solution. The user will be given the capacity for 
picture-driven animation, and also the ability algor ithmi cally 
to define picture change and algor it hmi cally to control the 
interpretation of the sketches and pictures through which he 
communicates with the computer. The algorithms may be 
expressed within the language of the system, using the com- 
mand set of APPL. This means that APPL will be an open-ended, 
multi-purpose animation system. 

On the other hand, there are advantages to holding fixed 
a few simple algorithms, and separating the imposition of 
dynamic behavior from the definition of static picture 
structure. We have discovered that even these simple algo- 
rithms, when augmented with powerful tools for manipulating 
movement and rhythm, yield a useful animation system. Further- 
more, I would estimate that this system, GENESYS, could be 
reimplemented on the TX-2 in U-6 man-months, whereas APPL 
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FOOTNOTES — I.B. 



(*l) Stephenson, 3 pp. 16-19. At this point, he also notes: 

"As a further compensation the added dimension 
of movement gives the cartoon an advantage which 
static art has been reaching out for over the 
centuries. Even the simplest drawing can he made 
interesting when things start moving. The composi- 
tion of the cartoon lies not only in the arrangement 
of lines and masses in each individual picture, 
hut in the relationship of one picture with the 
next--contrast or harmony will exist between pic- 
ture and picture, as well as within the individual 
image. Thus the cartoon, though lacking some of 
the possibilities of painting, nevertheless has 
a richness of its own which offers infinite pos- 
sibilities and presents a serious artistic 
challenge to the film-maker. 1 ' 

(*2) See Footnote 1, Introduction. 

(*3) The term "animation stand" refers to the animation camera 
and the rostrum upon which eels and cut-outs are ar- 
ranged and then photographed. 

(*U) It need not necessarily be an animated display of the 
object that is ultimately being driven by the path 
descripti on . 

(*5) Implementation of this mechanism is straightforward pro- 
vided one disallows any circularity in the relationships 
between movements. In other words, if b's movement 
depends on a's, and c's on b's, then a's cannot be de- 
fined in terms of either b's or c's. Allowing circular 
relations leads to the problem labeled by I. E. 
Sutherland as "constraint s at is fact ion ." 39 See also 
I.B. 10. and Footnote 8 (Ch.I.B.), and I.E. 2. 

(*6) There is an interesting difference between the eel 

class {"eyebrows raised", "eyebrows lowered"} and the 
eel class used to generate the reaction of the block. 
In the former example, each eel is a discrete identi- 
fiable visual state, which as a static image has 
significance in terms of its symbolic relationship to 
other members of the class. The latter case, on the 
other hand, illustrates that the eels need not represent 
static states to which we can attach nice verbal labels. 
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They are in a sense visual artifacts required for the 
synthesis of the dynamic from the successive presenta- 
tion of the static. 

(*7) Francis Chagrin, a highly experienced composer in 

animated films, writes in Halas and Manvell, 2 p. 238: 

". . .more often than not, the music is actually 
recorded first, then measured carefully (or 
charted) and all the exact points of emphasis 
marked and handed over to the animators. . . sound 
and vision have equal importance; they are equal 
partners, . . . preparing for it scrupulously by 
synchronizing their moods and their movements. . . 
both telling the same story at the same time. . . 
in perfect harmony and with s ingle-mindedness . I 
do not mean in unison; the harmony may be brought 
about by parallel movement or by counterpoint." 

(*8) The ability to group eel classes will also facilitate 
constraining these groups to move as a unit. 

(*9) The concept of a generalized-eel parallels what Max 
Bense calls an "aesthetic object." See Rei char dt , 2 5 
p. 72. 
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I.C.I. SPECIFYING GLOBAL DYNAMIC DESCRIPTIONS 

Six general approaches to the specification of dynamic 
descriptions may be distinguished: 

(1) The sketching or mimicking of a new pictorial 
representation of the description. 

Examples : Mimicking the ' bounc e , bounc e , spro ing , bounc e ' of 
the wedge in ' SPROINGBOINGZAP ' ; Drawing a rapidly oscillating 
waveform to represent the path description of the intensity 
of a 'burning sun' . 

(2) The editing or refinement of an existing pictorial 
representation of the description. 

Example 5 : Editing a picture of a selection description to 
lengthen one reverberation of the block in 'SPROINGBOINGZAP'; 
Resketching part of a waveform to add acceleration to the 
horizontal movement of the wedge. 

(3) The direct algorithmic specification of the data 
s equence . 

Example : Setting x(t) = x Q + v^t, y(t) = y Q + v Q t + (l/2)gt 
to determine the trajectory of an object falling to the earth. 
{h) The indirect algorithmic specification in terms of 
combinations of existing data sequences. 
Examples : Setting x £ (t) = x^t), y 2 (t) = y (t) + 1, so that 
objects #2 and #1 always move together, #2 remaining 1 spatial 
unit above #1 ; Setting x £ (t) = x^t-l), y £ (t) = y^t-l), 
s (t) = s (t-l), so that object #2 follows object #1 along a 
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trajectory, remaining exactly 1 temporal unit behind #1. 

b (t) and s (t) are selection descriptions operating upon the 

eel classes representing the two objects. 

(5) An indirect algorithmic extraction of the data 
sequence as the succession of values assumed by 
some aspect, or attribute, of a constituent picture 
in an existing animation sequence. (*l) 

Example : Computing f(t) = Distance between PIC.l and PIC. 2, 
when some other movement is to depend upon the relative motion 
of these two subpictures, whose absolute motion is already 
det ermined . 

(6) A coupling to a real physical process in the external 
world, such that it transmits a data sequence as 
(analog) input to the computer. 

Examples : Interesting couplings may be to particle collisions, 
the atmospheric pressure or wind velocity, a music waveform, 
or, in the case of (l) and (2), a real live animator. 

GENESYS contains techniques implementing the first, 
second, and fourth approaches only. APPL allows in principle 
arbitrary algorithmic specification of data sequences, as 
well as the dynamic computation (extraction) of a property 
and its recording as a movement description. 

The ability to accept continuous and discrete time series 
and sequences of pulses and waiting times is critical if one 
wants aspects of a movie to be precisely determined by pheno- 
mena of the real world, such as the output of scientific 
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experiments. These direct couplings to physical processes 
depend upon the existence of appropriate hardware, for example, 
analog-to-digital converters and input data channels* In the 
implementation of GEHESXS and in the design ©f AFPL ve have 
made no explicit provision for such inputs, aiuee only elemen- 
tary software is required. 

A system embodying all six gamaaral approaches , each 
represented by a vide variety -of specific techsi^ues^ *o»ld 
allow the truly plastics r«ff«wntettoa and aaftipwlation of 
dynamic information. (*2) 



-98- 



I.C. 2. WAVEFORMS, P-CURVES, AND OTHER PICTORIAL REPRESENTATIONS 
OF PATH DESCRIPTIONS 

Waveforms and p-curves are two kinds of pictorial repre- 
sentations of path descriptions. Both may be introduced with 
a single example. 

Consider the motion of a figure that goes from one corner 
of a square room to the diagonally opposite corner by walking 
along two adjacent walls. We shall ignore the vertical move- 
ment and consider only motion of the center of the body in 
the two dimensions of the plane of the ground. He first walks 
in the direction of increasing X coordinate, then in the 
direction of increasing Y coordinate. We further assume that 
he begins from a standstill, accelerates and then decelerates 
to the first corner, pauses there for a brief interval while 
he turns in place, and finally accelerates and decelerates 
to its destination. 

One complete description of this planar movement con- 
sists of the functions of the X and Y coordinates versus time. 
These are depicted in Figures I.C.I, and I.C. 2. Such repre- 
sentations of changing picture parameters are called waveforms . 
Time is depicted, in the waveform, along one spatial dimension. 
The waveform's construction requires movement of the stylus 
along that dimension; the display records and makes tangible 
this movement . 

Alternatively, both spatial coordinates could denote the 
two spatial coordinates of the movement. A natural 



correspondence is established between the X(Y) coordinate of 
the floor and X(Y) coordinate of the medium of the representa- 
tion (paper, scope face, etc.). Figure I.C.3. depicts such 
a parametric curve representation of the movement. It illus- 
trates with clarity the figure's path on the floor. 

Yet the dynamics of the motion are hidden because the 
temporal dimension is only an implicit coordinate. This 
rectified in Figure I.C.U. A stream of symbols is used in- 
stead of a continuous trail to depict the path. Characters 
are spaced along the path at short, uniform intervals of time, 
such as every 2k th of a second. Dynamics are apparent in the 
local density of symbols. Observe in particular how they 
cluster where the figure pauses. 

The dynamic construction of a path description is a user- 
driven animated display in which the timing of the stylus's 
movement is preserved by recording its position in every frame . 
A tangible representation of the stylus's movement is the 
dynamic display of a lengthening sequence of characters spaced 
equally in time. We shall call a parametric curve dynamically 
sketched in real time a p-curve . The p-curve corresponding to 
Figures I.C.l.-i+. is depicted in Figure I.C.6. We have 
attempted to convey in a single static image that the p-curve 
is a dynamic display. Each 2-dimensional p-curve determines 
two path descriptions. Thus the bouncing of the wedge in 
'SPROINGBOIKGZAP ' may be synthesized by "bouncing" with the 
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stylus along some path on the tablet surface, that is "by 
mimicking the desired dynamic. 

The waveform and the p-curve illustrate two aspects of 
the representation of time that apply to all pictures of 
dynamic descriptions: 

(1) Pictures and actions are termed static when real 
time and movie time are independent, when the passage of 

real time in the display or construction of a dynamic descrip- 
tion bears no fixed or useful relationship to the dynamics of 
the animation sequence eventually driven by the description. 
Alternatively, pictures and actions are termed dynamic when 
real time and movie time are closely coupled, when picture 
change and interactive input are clocked, controlled and 
coordinated by the computer so that they depict and define 
the dynamics of the eventual movie. We say that these dynamic 
processes occur in real time . 

(2) In the visible record of a dynamic description, movie 
time can be represented as an explicit axis such as the hori- 
zontal; the user then draws movie time explicitly along that 
axis. Alternatively, movie time can be represented implicitly 
along a curve by a technique such as the controlled spacing of 
a trail of symbols. 

Table 1 summarizes how these distinctions apply to our 
definitions of waveforms and p-curves : 
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Act ions 
and pictures 
are dynamic, 
real-t ime 


Actions 
and pictures 
are st at i c , 
not real-t ime 


Movie time 

is an 
explic it 
axis 


XXX (*3) 


Waveform 


Movie time 

is not 

an explicit 

axis 


P-curve 
Strobe 


Point-by-point 

p-curve 

( paramet ri c 

curve ) 



Table 1 
PICTORIAL REPRESENTATIONS OF PATH DESCRIPTIONS 

There is a significant qualitative difference between 
"playing back" the animated display that is a p-curve very 
rapidly and very slowly. At 12 or 2k frames per second, con- 
tinuous movements of the stylus are accepted; discontinuities, 
that is, large gaps between deposited symbols, can be intro- 
duced by lifting the pen, thus stopping playback, and then 
repositioning it again. At 5 seconds per frame, lifting the 
pen allows each point of the parametric curve to be individually 
positioned. Since the dynamics of lifting the pen have no 
effect on the dynamics of the resulting path descriptions, the 
action of a point-by-point p-curve does not occur in real time. 

Still another mechanism for displaying existing two- 
dimensional movements is called the strobe . (*U) Consider 
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the spatial and temporal superposition of a p-curve and its 
corresponding parametric curve. Assume that each is repre- 
sented by visually distinguishable symbols. The p-curve 
component traces the movement dynamically. The static component 
allows the viewer to see the entire trajectory throughout the 
duration of the dynamic trace. Because of the overlapping 
static component, only the leading point of the p-curve is of 
interest. Therefore, we replace the growing trail of symbols 
that is the p-curve with a moving marker that represents its 
leading point. One frame of the resulting strobe is portrayed 
in Figure I.C.5. The display resembles symbols moving across 
an array of neon lights, and also the airport strobe lights 
which guide pilots down a runway. The strobe gets its name 
from this similarity. 
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(i; 





[2) 



(3! 



(1) The X coordinate waveform of a movement. 

(2) The Y coordinate waveform of a movement. 

(3) A parametric curve representation of the same movement. 
The rhythm of the motion is not visible. 



Figures I.C.1-3 
PICTORIAL REPRESENTATIONS OF A CONTINUOUS MOVEMENT 
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(h) 



(5) 



(10 A tetter display of the parametric curve of Figure I.C.3. 
Symbols are deposited at short, uniform intervals of time. 

(5) One frame of the strobe corresponding to Figures I.C.l-U. 
The strobe is a dynamic display, in which superimposed on 
a static parametric curve is a marker tracing in real time 



the trajectory. 



Figures I.C.U-5 
THE PARAMETRIC CURVE AND ITS STROBE 
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(6) The p-curve corresponding to Figures I.C.1-5. The dynamic 

display is compressed into a single static picture containing 
nine selected frames, the 1st, 2nd, 1+th, 8th, l6th, 32nd, 
Ulst, 50th, and 60th. 



Figure I.C.6 
THE P-CURVE 
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I.C. 3. PICTORIAL REPRESENTATIONS OF PATH DESCRIPTIONS 
— AN ANALYSIS 

The various pictorial representations of path descrip- 
tions should he compared and contrasted on at least the 
following criteria: 

(1) their utility as mechanisms for defining new move- 
ments, and the quality of visual feedback provided 
the animator during this process; 

(2) the number of dimensions of dynamic information 
that can be represented, and the ways in which the 
dimensionality is used to advantage; 

(3) their role in guiding spatial and temporal adjust- 
ments to existing movements, and the naturalness 
and flexibility of the mechanisms that effect these 
changes ; and, 

{10 their capacity for meaningful conceptual extensions. 
These criteria also apply to representations of selection and 
rhythm descriptions. 

One major concern links our discussion of these issues. 
Recent experience with GENESYS has confirmed that a critical 
problem of picture-driven animation is that of coordinating 
various parallel actions, or concurrent dynamic activities. 
The relationships between actions, between movements, are 
more important than the character of each individually, for 
actions are always interpreted in context. With global 
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dynamic descriptions an animator can easily control entire 
intervals of individual movements. This chapter describes 
methods (better ones are still sought) for guaranteeing that 
desired constraints, or relationships between the movements 
of several objects, are satisfied, both at individual frames 
and over entire intervals of time. (*5) 

Defining and Displaying Movements 

Using static representation, such as a waveform, to de- 
fine a new movement requires a thorough rationalization of 
the desired dynamic behavior, in other words either previsualiz- 
ing or making analytic the changes of picture parameters 
with time. A waveform can also be used to depict the re- 
lationship with time of any picture parameter in an existent 
dynamic sequence. We have seen that these parameters may be 
spatial coordinates, scale factors, intensity variables, or 
line thicknesses. The display of a waveform highlights such 
regular behavior as a constant rate of change or such 
symmetries as periodicity or a perfect reversal of a given 
mot ion. 

The p-curve is the direct mimicking of a movement's 
trajectory in an appropriately chosen space. The single 
action of the two-dimensional p-curve is equivalent to 
sketching two waveforms. Use of the p-curve facilitates a 
direct transmission to the computer of an intuitive feeling 
for a motion, of a bodily-sensed rather than visually- 
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rationalized dynamic. There are certain movements, such as 
a flutter, a tremor, and a thrust, which cannot be analyzed 
or formalized as easily as they can be mimicked with a hand 
motion. Emotions, too, are spontaneously conveyed by human 
motor behavior, as described by Arnheim in the following 
passage : 

Physiognomic movement is the component of bodily ac- 
tivity that spontaneously reflects the nature of the 
given personality as well as that of the particular 
experience at the given moment. The habitual firmness 
or weakness, confidence or timidity of a person is 
expressed in his movements. At the same time his 
bodily behavior will reveal whether he is interested 
or bored, happy or sad at this particular minute. 

Descriptive movements are deliberate gestures meant 
to represent perceptual qualities. We may use our 
hands and arms, often supported by the entire body, 
to show how large or small, fast or slow, round or 
angular, far or close something is or was or could be. 
Such gestures may refer to concrete objects or events 
--such as mice or mountains or the encounter between 
two people — but also figuratively to the bigness of a 
task, the remoteness of a possibility, or a clash of 
opinions . . . . ( * 6) 

Display of a two-dimensional p-curve sometimes obscures 
precise temporal relationships, for it may be difficult to 
see how many frames separate pairs of points along a trajectory. 
The p-curve does depict clearly the temporal concurrence of 
the values of the two changing parameters which are repre- 
sented. This is most useful for pairs of coordinates which 
are closely coupled intuitively, such as pairs of spatial 
coordinates of one object. The clearest static representation 
of the dynamics of a bouncing ball is a multiple-exposure, 
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high-speed photograph of the trajectory of the ball, and 
that is essentially the parametric curve. 

Experience has shown that it is difficult and unnatural 
to conceive of two-dimensional spatial movements in terms of 
the two waveforms that are its formal equivalent. The point- 
by-point p-curve is a technique for defining such a motion 
directly in the plane, without being required to mimic it. 
Display of the strobe of an existing movement, as we shall 
see i n i.e. 7., should aid the mimicking of a new movement in 
relation to the existing one. 

Occasionally one may wish to mimic dynamic behavior 
that consists of a variation with time of one parameter only. 
If the p-curve technique is used, only one of the resulting 
path descriptions is needed. In I.D. we depict the flutter- 
ing of a heart by rapidly varying its size. In a system with 
suitable algorithmic control, the animator assigns the X [R] 
coordinate of the p-curve to a parameter determining the 
size of the heart, and then flutters the stylus back and 
forth horizontally [radially]. Any vertical [angular] motion 
of the stylus is uninteresting and is ignored. 

Dimensionality 

A p-curve represents one more dimension than does a 
waveform. The stick figure experiment, discussed in I.E. 2., 
established early in the research the utility of defining 
a two-dimensional movement with a single action. On the 
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other hand, two dimensions can only he defined jointly if 
they are closely coupled intuitively. Thus, we do not know 
if the added dimension is useful in situations other than 
that of pairs of spatial coordinates of the same object. 

The p-curve allows a natural extension to three dimen- 
sions; one can trace a spatial path with a wand as easily 
as a planar path with a tablet stylus. Sketching a spatial 
waveform of two coordinates and time, on the other hand, seems 
awkward, due to the difficulties in controlling the wand as 
well as the lack of a suitable related feedback mechanism. 

The use of additional hardware graphically illustrates 
the power of the dynamic input of a multi-dimensional parametric 
curve. The Computer Image Corporation has built an electro- 
mechanical harness which records data about the bending of 

the joints (and hence the movement) of the man who is wearing 

29 
it. This allows the direct transmission of life-like 

dynamics, ideal for driving motions of a computer model of a 

human figure or an abstract stick figure. If music is 

synchronized by using it as the driving function for other 

dimensions of the movement, then the animation becomes even 

more energetic and life-like. 



Refining existing movements 

The waveform and the parametric curve each play a role 
in the spatio-temporal adjustments of existing movements. 
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Consider a display of the waveforms of a number of related 
parameters superimposed against a common time axis. Such a 
representation is natural for sequencing or pacing a number 
of concurrent movements. It has been useful to mark inter- 
esting events, or critical instants along the time axis, with 
a rhythm description. In the case where the coordinates of 
the p-curve do in fact denote spatial coordinates, spatial 
alignments of different objects are facilitated by use of 
their parametric curves. 

Conceptual extensions 

The concept of the waveform may easily be extended to 
other qualities of a motion such as the velocity. A similar 
extension of the p-curve does not appear to be useful. 
Although one could construct a p-curve plotting the changes 
of one velocity against another, it would be difficult to 
synthesize and conceive of a motion in these terms. 
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I.C.I+. SKETCHING AND RESKETCHING PATH DESCRIPTIONS 

Several observations may be based on accumulated 
experience sketching and resketching pictorial representa- 
tions of path descriptions, both statically and dynamically. 

Static Sketches (Not made in real time) 

The fact that the functions representing waveforms must 
be single-valued may be exploited in the sketching process. 
One traces back and forth over a particular region of the 
curve, continuously replacing old values with new ones, thereby 
refining the shape of the waveform. 

A particular problem arose in ADAM, the stick figure 
experiment, when sketching waveforms of rotation angles, whose 
maximum and minimum values ( +18 0° , -l80° ) are considered equal. 
A curve can therefore go continuously from the greatest 
positive values to the greatest negative values. The animator 
should not have to break the continuity of his sketch in 
crossing an arbitrary boundary, such as 180°. A solution 
implemented in ADAM is that of identifying several regions 
of the display with a single range of values of the waveform. 
Specifically, while the animator continues sketching an ef- 
fective 180°, 190°, 200° ... a copy of this segment of the 
waveform appears at -l80°, -170°, -l60° . . . Only when it 
is convenient does he interrupt the sketch and continue it 
below. Commands for scaling and windowing pictures, aug- 
mented by good clipping mechanisms, would aid the application 
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of this technique. ( *T ) Such commands would also aid the 
resketching of path descriptions, for one could work on en- 
largements of particular portions of their waveform and 
parametric curve representations. 

Another solution of more general interest, discussed but 
not yet implemented, is that of displaying waveforms so that 
the parameter being defined is represented by the identical 
parameter in the picture. In the case of rotation angles, 
the waveform is plotted in polar coordinates, R is identi- 
fied with movie time in frames, and 6 represents the angle to 
be varied. Values of the angle that will be used in succes- 
sive frames of the movie are placed at increasing distance 
from the origin. Application of this technique, automatic 
in the construction of waveforms of Y versus time, might also 
be appropriate to the definition of X coordinate and scale 
factor variations. In the former case, the waveform is 
plotted from bottom to top instead of left to right, with the 
X coordinate of the display representing X, and the Y co- 
ordinate of the display representing movie time. In the 
latter case, R is identified with the size parameter, and 
with the time in frames. 

We noted in I.C.3. that a parametric curve is an intui- 
tively natural coupling of pairs of spatial coordinates, and 
hence more effective than a pair of waveforms as a vehicle 
for defining two-dimension spatial movements. New parametric 
curves may be constructed in real time, with a p-curve, or 



not in real tine, by positioning individual points of the 
curve. Currently in GEBESYS, if only one dimension of a 
given movement need be altered, the corresponding waveform 
must he resketched. A new technique, which allows this to 
he done directly on the parametric curve, has been devised 
though not yet tested experimentally. Specifically, the 
method allows the animator to change the variation of 
x(t)[y(t)], while holding y(t)[x(t)] constant. Because a 
parametric curve can be multi-valued, the animator must 
designate the first and last points of the region of the 
curve to be resketched. Suppose, for example, that x(t) is 
to remain fixed, the varying stylus location is represented 
by (x ,y ), the initial point to be altered is (x^y^, 



s ■ s 
a 



i i 
nd the next point along the curve within the designated 



region is U^g)- The stylus is set down on the surface 

of the tablet at (x ,y ), and the first point of the curve 

s l s l 
is repositioned at (x n ,y c )• Sketching begins, and when the 

_L Sj_ 

stylus coordinate x =x„, the second point of the curve is 

moved to {x ,y ). Intuitively, points on the old curve are 

^ s 2 
projected directly upwards or downwards to become points on 

a new curve. Since these coordinate pairs are the values of 
the X and Y path descriptions at successive frames, the 
variation of X with time is not altered. Because the animator 
must move strictly forwards and backwards between the bound- 
aries of the delimited region of the curve, mult i-valuednes s 
is no longer a problem. The technique is formally equivalent 
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to sketching y(t) directly as a waveform. Intuitively, how- 
ever, it is very different, because it uses a display which 
depicts correctly and naturally the coupling of X and Y. 

Dynamic Sketches (Made in real time) 

A problem in the sketching of p-curves is that of the 
synchronization of the hand to the computer in the beginning 
transient of the movement. One solution is the use of a 
countdown procedure. Another is to begin clocking before the 
start of the movement, and in subsequent editing to chop off 
the excess on the curve. In any case, editing can later be 
used to adjust the initial values assumed by the path de- 
scriptions . 

We have noted that discontinuities In a p-curve can be 
introduced by lifting the stylus from the surface, since this 
temporarily halts the clocking of the movement. 

It is difficult, when mimicking a motion, to control 
accurately its exact duration in frames. A satisfactory solu- 
tion would allow the animator to sketch a p-curve without con- 
cern for its duration. If its length then fails to satisfy 
some other constraint imposed by the film, it can be scaled 
linearly in time to the desired length. 

More generally, it is difficult to control accurately 
both the position and the speed of a movement. There appears 
to be, as one would expect, intrinsic constraints in the 
medium of hand motions. It Is relatively easy, for example, 
to move quickly and accurately at regions of high radius of 
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curvature, and then slowly at regions of low radius of curva- 
ture. It is difficult, on the other hand, to do the converse. 
This observation, and other evidence to be introduced, sug- 
gests that the capability for dynamic mimicking must be 
augmented by an editing capability, a system for refining 
existing movements, if we are to achieve a flexible defini- 
tion facility for a wide variety of dynamic behavior. 

A technique has been devised, though not yet tested in 
practice, for combatting the difficulty in controlling both 
the position and the speed of a movement. The idea is to 
control each in separate motions. One would first sketch a 
p-curve without concern for the speed of the movement, con- 
centrating only on the shape of the parametric curve. After 
the curve is suitably defined, we would retrace it with the 
appropriate dynamics, concentrating on the speed rather than 
on the exact position of the stylus. The system would then 
automatically project points from the new curve onto the old 
curve, presumably by a technique of orthogonal or minimum 
distance projection. Thus the precise spatial characteristics 
of the first movement would be combined with the dynamics of 
the second movement. 

Another method, which we have used, is to concentrate 
first on mimicking the correct dynamics. We then adjust the 
spatial characteristics of the resulting curve with the 
editing system. This facility for refining existing move- 
ments is our next topic. 
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I.C. 5. EDITING AND GRAPHICALLY REFINING PATH 
DESCRIPTIONS (*8) 

Whereas the previous section presented methods for re- 
sketching a path description free-hand, "both in real time 
and not in real time, this section introduces methods that 
do not require a sketch. Once a path description has been 
evaluated and judged not to he quite right, it is often 
easier to modify it rather than redraw it. These modifica- 
tions, harking back to the distinctions of I.C.I. , fall under 
category (2), refinements of existing pictorial representa- 
tions, and category (k) t indirect algorithmic specifications 
in terms of existing path descriptions. 

We shall descrihe four major kinds of editing capabilities, 
operations for: 

(1) scaling curves; 

(2) reshaping them; 

(3) algebraicly combining them; and, 

(h) logically combining them, including pattern 

scanning, matching, and transforming functions. 

Operations of the kind described in I.C.I*, and I.C. 5. should 

enable precise control to be exercised over the texture of a 

motion . 

Scaling Curves 

The need to scale path descriptions is accentuated by 
the difficulty noted above, that of controlling while sketch- 
ing the precise magnitude and duration of spatial excursions. 
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Additive (multiplicative) scaling of the ordinate of a wave- 
form is equivalent to the algebraic sum (product) of that 
waveform and a scalar or another waveform. Selective 
acceleration and decelerations of portions of a motion may 
he achieved "by replacing "t" with a function "f(t)", which 
we call "generalized temporal scaling." A path description 
"x(t)" is thus mapped into "x(f(t)}", the algebraic composi- 
tion of the two time functions. All tools available for 
sketching waveforms should obviously be made applicable to 
the contruction and modification of scaling functions. 

Our animation experience suggests that generalized 
temporal scaling is a technique more powerful than would in 
common practice be needed. A simple linear scaling command 
is exceedingly versatile if one can arbitrarily delimit the 
section of the path descriptions to be scaled. One would 
frequently choose a critical point on a waveform, and then 
shrink and expand by a given number of frames sections 
delimited on either side of the point. 

Reshaping Curves 

Scaling is the simplest example of the reshaping of path 
descriptions. More generally, one may take a curve, "attach" 
the stylus to one of its constituent points, and move it to 
a new position. A variety of algorithms can be used to com- 
pute how points adjacent along the curve are altered. For 
example, a vertical pull could define a deformation or 
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stretching whose effect diminishes (say, exponentially) on 
either side of the attached point. The decay constant, or 
stiffness factor of the curve, could he varied by a knob or 
by a pressure sensor in the tip or on the side of the pen. 
(*9) Alternatively, we may wish to maintain the trajectory 
of an existing two-dimensional movement, but vary the rate 
at which part of it is traced. If points along the parametric 
curve are viewed as beads on a string, we reposition some of 
the beads by designating one point of the string with the 
stylus, and giving it a quick vertical impulse. As before, 
we control the magnitude and extent of the reshaping opera- 
tion by several numerical parameters, which in this model 
represent the mass of the beads, the strength of the impulse, 
and the effects of gravity and friction. 

One would actually like to control reshaping so that 
certain constraints remain satisfied. For instance, if a 
particular point on a given curve defines a desired exact 
collision between two objects, then this point should remain 
fixed. Two other simple examples are requiring a curve to 
hold a given velocity in a certain region, and constraining 
it not to exceed a given ordinate value. The latter condi- 
tion could be used, for example, to guarantee that one object 
would not penetrate another. One may wish to hold fixed the 
locations and heights of certain maxima and minima while 
rounding and smoothing, or sharpening and intensifying the 
peaks. One may also wish to make more or less continuous 
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and gradual certain level transitions. 

There is only one implicit constraint mechanism currently 
in GENESYS, and it is heavily used. The animator may estab- 
lish a Left Boundary and a Right Boundary, which delimit an 
interval of frames. Any activated sketching, resketching, or 
editing operation can only effect frames within the region 
currently delimited. This is a good way to localize effort 
within a particular interval of movie time. The feature also 
provides valuable protection against inadvertently altering 
an already perfected section of a movement. 

Algebraicly Combining Curves 

We have already seen the value of algebraic combinations 
such as the negation of a path description, which defines the 
reversal of a movement, and the composition of two path 
descriptions, which results in generalized temporal scaling. 
The sum of two path descriptions superimposes synchronized 
motions. For example, one generates a cycloid from the combi- 
nation of a circular movement and a straight line movement. 
The difference of two path descriptions represents relative 
motion. In these examples path descriptions are interpreted 
as arrays of numbers, and algebraic operations are applied 
element-by-element to the values at corresponding instants 
of movie t ime . 

Logically combining curves 

Sections of path descriptions may also be viewed as 
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ordered strings of elements. Operations on strings such as 
c ancat enat ions , insertions, deletions, periodic repetitions, 
delays (phase shifts), and head-to-tail inversions combine 
and extend existing dynamic sequences. Cane at enat ion 
causes one movement to follow after another. Insertion is 
used to insert one movement somewhere in the middle of an 
existing movement. An important special case in practice is 
the insertion of a string whose elements have a constant 
value equal to that of the element at the point of insertion, 
for this is a mechanism whereby holds, or pauses, are intro- 
duced into a motion. Deletion removes unwanted parts of an 
existing movement. The other operations may also he simply 
explained. 

One could extend the interpretation of path descriptions 
as strings of symbols by providing a pattern-matching capa- 
bility. Coupling this to standard scanning and pointing 
mechanisms would allow one to isolate aggregates of points 
satisfying criteria such as a constant velocity, accelerations 
greater than a prescribed limit, or a particular kind of dis- 
continuity. The isolated aggregate could then be transformed 
in such ways as being smoothed or having a constant velocity 
transition introduced. Within this framework one could 
generate particular stylized kinds of dynamic behavior. 
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I.C. 6. SPECIFYING SELECTION AND RHYTHM DESCRIPTIONS 

Selection and rhythm descriptions are conceptually 
discrete phenomena; path descriptions, continuous. Whereas 
the elements of a path description are arbitrary real num- 
bers, the elements of a selection description are small 
positive integers. A rhythm description may he viewed as a 
sequence of integer values of movie time, or as a Boolean 
sequence, a succession of ones that represent events and 
zeros that represent the absence of an event. Techniques for 
the construction of discrete dynamic descriptions are con- 
siderably simpler, yet conceptually similar to those used in 
the synthesis of continuous dynamic descriptions. 

We have used various hardware devices in the static 
definition of selection and rhythm descriptions. Pictures 
of the former as a sequence of levels or steps, and of the 
latter as a sequence of pulses or event markers, may be 
drawn and accepted by suitable stylus input routines. Such 
pictures appear in Figures I.E. 8, IT, and 18. It is often 
quicker to type rather than to draw a sequence of choice 
values, pulse positions, or intervals of movie time. Indivi- 
dual pulse positions may also be accurately positioned with 
a knob. Precision to the individual frame, often not essen- 
tial with descriptions of continuous change, is usually 

critical here. 

Like path descriptions, selection and rhythm descriptions 



-123- 



may "be dynamically defined. What is required in the former 
case is the isolation of discrete positions or regions to 
which the stylus position in each frame can he assigned. 
One could for instance mimic in real time a line of music, 
moving the pen up and down as a baton on a hypothetical 
staff in the tablet surface. An appropriate algorithm would 
map this action into a selection description. A direct and 
simple dynamic input of a rhythm description consists of the 
tapping of a push-button. What more natural way to describe 
a beat such as "/ II I I /" is there than to actually 
mimic it to the computer ... "/ // / / /". 

Tools for the editing of selection and rhythm descrip- 
tions are also required. The principles behind temporal 
scaling as applied to path descriptions are equally applic- 
able here, although the analog to waveform shaping does not 
seem useful. All string operations carry over from the 
continuous descriptions to the discrete ones. There are 
element-by-element logical operations, such as "and" and 
"not", which correspond to the algebraic functions on wave- 
forms . 

A particularly useful discrete function is achieved by 
a simple coupling of a selection description and a rhythm 
description. A selection description is considered to be 
time-independent , if successive elements of the data sequence 
indicate only the order in which elements are to be chosen 
but not the time interval over which each choice is to apply. 
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Thus, if there are three states of the mouth, a grin, a 
smugness, and a frown, then the time-independent selection 
description SI = (1,2,3,2,3) indicates only that the mouth 
undergoes the transition sequence gr in- smugnes s-f rovn- 
smugness-f rovn . This description can be altered into a 
t ime-based selection description through the definition of 
a rhythm description R = ( 3 , 2 , i+ , 1 , U) , whose successive ele- 
ments represent the intervals during which each state exists. 
A system which had a suitable command and implementing al- 
gorithm could transform SI and R into the time-based selec- 
tion description representing the frame-by- frame evolution 
of the mouth, S2 = (1,1,1,2,2,3,3,3,3,2,3,3,3,3). GENESIS 
contains, in crude fashion, a mechanism for doing this. 

The concept of the dynamic pattern is suggestive when 
applied to discrete dynamic descriptions. Graphic repre- 
sentations of particular recurring movements, such as walking, 
kicking, and biting, appear as easily distinguishable patterns 
in the selection descriptions of Figure I.E. IT. Periodic and 
almost periodic sequences of choices from a eel class are 
useful in animation. So are regular sequences of intervals 
between transitions or other events. 

We often want to constrain sets of selection sequences. 
For instance, whenever the eye of a particular cartoon figure 
is closed, the lower eyebrow position would be the correct 
choice. Discrete analogs to smoothing operations are also 
meaningful. An example is the introduction of one frame of 
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I.C. 7. COORDINATING PARALLEL ACTIONS 

Two methods already presented are particularly useful 
for coordinating and synchronizing concurrent dynamic 
act i vit i es : 

(1) Graphing dynamic descriptions along a common axis 
of movie time, which is depicted in Figures I.B.I, I.E. 8, 
and I.E. IT, aids the synchronization of one dynamic strand 
to another. (*10) In practice, we place event markers along 
the axis to aid the process of relating the values of several 
descriptions at one instant or interval of movie time. We 
can identify from the appearance of the selection description 
of the eel class 'mouth 1 , for example, those intervals in 
which a character's mouth is in the fully open position. We 
then use this information to refine the selection description 
of the eel class 'leg*, thus guaranteeing that his foot will 
he in the mouth soon after it is opened. 

(2) Interacting spatial movements of several objects 
may he improved by graphically editing their parametric curve 
representations. Symbols on adjacent curves, when viewed in 
the correct correspondence, directly depict the relative 
spatial position of the objects in particular frames. 

We can distinguish at least three other techniques which 
help achieve correct coordination: 

(3) The attachment point of a eel is that constituent 
point whose coordinates are precisely defined by the path 
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descriptions which drive the eel. When sketching p-curves 
and parametric curves, the animator can better relate one 
movement to another if he can control and vary a eel's attach- 
ment point. For some movements of the wedge in ' SPROINGBOINGZAP ' 
driving the center of the wedge is appropriate; for other 
movements, such as its striking the "block, one should mimic 
the motion of the wedge's lowest point, since it and not the 
center makes contact with the block. 

(h) We have developed an untested method for using the 
strobe to guide the dynamic mimicking of one motion in rela- 
tion to another already defined. The technique is to play 
back the strobe of the existing movement while sketching the 
new p-curve. The static component of the strobe, the under- 
lying parametric curve, should allow one to anticipate its 
trajectory and thereby better relate the new trajectory to 
it. The dynamic component of the strobe, the moving marker, 
should aid the synchronization of the rhythm of the new move- 
ment to that of the old movement. 

(5) Often it is futile to work globally, over an inter- 
val of time, until a single critical frame is corrected. 
Such frames are usually transition points— instants of colli- 
sion, beginning or final frames of movements, or pauses in 
an activity. Our limited experience suggests strongly that 
the ability flexibly to construct and adjust such individual 
frames is critical to the success of a picture-driven anima- 
tion system. This is because it may be too difficult, and 
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it certainly has thus far seemed unnatural, to establish by 
global operations all the subtle interrelationships that occur 
in individual frames. After perfecting a key frame, however, 
we can better sketch the path descriptions that emanate for- 
wards and backwards from it in time. Furthermore, we can 
sometimes interpolate path descriptions between two perfected 
frames . 

This observation does not detract from the value of 
global dynamic descriptions and operations over them. It is 
simply a restatement of what should be obvious: they do not 
solve all the problems of animation. Global descriptions are 
useful when there is significant regularity in the changes 
of some aspect of a picture over an interval of frames. If 
there is no regularity from frame to frame, or if the rela- 
tionships within a frame are more significant than the rela- 
tionships from frame to frame, then it may be better to work 
individually on some or even all of these frames. It is too 
early to predict what mix of global and local operations would 
be used by an animator fluent with GENESYS and with the way 
of thinking developed in this dissertation. Ideally, he 
should work both globally and locally, each where most ap- 
propriate. Further details on local operations in GENESYS 
are given in I.E.U. 
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I.C. 8. IMPLICATIONS OF THE FACT THAT 

DEFINING AND REFINING DYNAMIC DESCRIPTIONS 
IS AN ART 



We recognize that this chapter has been rather vague 
about the relative importance of the many listed techniques, 
and the extent to which each is successful in aiding an 
animator working on actual animation sequences. Clearly, 
the experimental aspects of the ideas discussed above have 
thus far been explored to a limited extent only. 

On the other hand, a few additional months of experi- 
mental work would still not yield precise rules for the usage 
of each specific technique. What constitutes the most effec- 
tive set of tools for manipulating global dynamic descrip- 
tions depends heavily upon the artist, his range of exper- 
ience with the medium, and the effects he is seeking to 
achieve. It is therefore essential that a picture-driven 
animation system be easily adaptable to the needs of the user. 
Let us analyze the meaning of the desired flexibility in a 
pair of important examples. 

(l) A critical problem of picture- driven animation is 
relating the structure of eels (form, composition, balance) 
to the structure of the imposed dynamic behavior (movement 
and rhythm). This problem, which arises because picture- 
driven animation separates the definition of static and 
dynamic structure, is related to the difficulties of coordi- 
nating parallel actions. (*ll) There are two aspects to the 
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problem: What information about eels and their interrela- 
tionship does an animator need to define successful picture 
dynamics? How should the animation system aid in making 
this information accessible and tangible, through providing 
appropriate displays? 

More specifically, we ask: What should be visible when 
an animator is sketching or refining a path description? How 
can we combat the difficulty in utilizing the visual feed- 
back provided by a p-curve's display while dynamically 
sketching that curve? Should the eel class under the con- 
trol of the path description be concurrently displayed, or 
all "closely related" eel classes, or complete frames? 
Should this display be static, that is consisting of con- 
tents of individual selected frames, or dynamic, that is 
changing to show the frame affected by the animator's action 
at a given instant? Should representations of other dynamic 
descriptions be visible for comparison? 

Thus, when the animator dynamically mimics a movement 
over the interval, frame a through frame b, what else should 
be visible on the display? A possible solution is: The 
current contents of frame (a-l) and frame (b+l) should be 
visible, for this will aid relating the p-curve to the 
structure of the frames just before and just after the new 
movement. However, display of these frames may be unneces- 
sary if the object's motion is independent of other objects 
in the picture, may be unwise if the frames are so complex 
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that the scope "becomes hopelessly cluttered, and may be 
inadequate if it is really the intermediate rather than the 
beginning or final states of the movement that must be closely 
coupled to other aspects of the scene. 

(2) The second example deals with the naming of struc- 
tures. We have already presented the need for flexible 
aggregation mechanisms for eels and eel classes. There is 
a parallel need for naming and manipulating arbitrary aggre- 
gates of global dynamic descriptions. Such aggregates would 
be useful when trying to relate movements of various eel 
classes . 

How do we achieve the desired flexibility? In GENESYS , 
we continue to add new mechanisms and refine existing ones. 
To deal with the first problem area named above, we would 
provide GENESIS with commands for positioning and scaling 
individual pictorial representations of eels and dynamic 
descriptions, and commands for making these visible and in- 
visible. To deal with the second problem area, we would 
provide GENESYS with commands for grouping and naming groups 
of dynamic descriptions, and extensions of existing commands 
so that they apply to such groups as well as to individual 
des cr ipt ions . 

Thus we continue to add to the system new kinds of en- 
tities (new data types), and new commands which operate upon 
these data types. I contend that this approach is awkward 
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and inelegant because of the fragmentation of the resulting 
conceptual structure. GENESYS was not built with such exten- 
sions in mind, and so its growth is labored. 

On the other hand, controlled and graceful extensibility 
may be achieved if we prepare for it by basing the system 
design at a fundamental level of abstraction, with the proper 
primitive structures and operators. Cels, dynamic descrip- 
tions, and animation sequences are not good primitives because 
they are too specialized. There are needed structures and 
operators, in terms of which the existing mechanisms of a 
system like GENESYS can be simply expressed, for then they 
can be made accessible for rapid modification and augmenta- 
tion. Part II presents APPL, a new animation language designed 
with these issues in mind. The language is low-level enough 
to express the algorithms needed for picture-driven animation, 
yet high-level enough that the programs implementing these 
algorithms are relatively simple, and may therefore be changed 
with ease. In an animation system based on APPL, the animator 
could more easily comprehend how his system works and what 
is required to add new features and tailor it to his demands. 
The result would be a flexible, adaptable, multi-purpose 
animation machine. 
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FOOTNOTES -- I.e. 



(*l) Notice that in approach (h) the data sequence is com- 
puted from existing data sequences, but in approach 
(5) it is computed directly from the movements of 
existing pictures. 

(*2) It is hoped that APPL will he such a system, once it 

is implemented, provided with a variety of these tech- 
niques through definitional extension, and augmented 
by capabilities to accept direct analog input. 

(*3) If the X coordinate of the stylus movement is identified 
with movie time, then the movement cannot also be 
sketched in real time, for the value of movie time ob- 
tained from the stylus position will rarely equal that 
obtained from the value of real time. We could, however, 
augment a p-curve with two growing waveforms appearing 
on another portion of the scope. In this case, the 
user would still be generating a p-curve, and not sketch- 
ing a waveform. 

(**0 I am indebted to Dr. W. R. Sutherland for suggesting 
the concept of the strobe. 

(*5) Using frame-by-frame techniques, the animator works on 
each individual frame and thereby satisfies constraints 
local to a frame. In picture-driven animation, he works 
directly on sequences of frames, exercising global con- 
trol over entire intervals of time. This economy of 
effort must not be achieved at the expense of loss of 
control over the relationships between objects in a 
scene. 

(*6) Arnheim, ° pp. 165-166. 

(*?) 'Scaling' means enlarging or reducing in size. 'Window- 
ing' means isolating and viewing a scaled version of a 
region of a picture, and usually implies that one will 
scan parts of the picture by moving the 'window'. 
'Clipping' means removing from the display those por- 
tions of lines and curves that fall outside the window. 

(*8) The term 'to edit 1 is used in the broad sense of 'to 

correct, to prepare, to arrange', and not In the narrow 
sense of 'to rearrange sections of photographic film', 
as is often done by splicing them. 

(*9) Work on the shaping of surfaces in 3-space by Steve 

Coons, 61 and a related exploratory study by Tim Johnson, 62 
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support the claim that such tools are useful. None of 
these have yet been implemented in GENESYS. 

(*10) There is a strong analogy between displaying a group 

of dynamic descriptions on a common time axis and what 
is called a Work Book in commercial animation. The 
Work Book is a linear sequence of blocks, each contain- 
ing information about a successive unit (such as half a 
second) of the movie. It is described in Halas and 
Manvell, 2 pp. 171-2: 

The work Book is derived directly from the final 
storyboard [the visual presentation of the idea of 
the film in a series of sketches], and is an analysis 
of each shot and sequence on a f r ame-by-f r ame basis. 
In this way the exact timing of every individual 
movement is determined, and its i ust er-relation with 
all other movements fixed at any given moment. 

The Work Book must also show what in a live- 
action film would be called the camera movement-- 
any movement, that is, which is the equivalent of 
a tracking-in, panning or tilting shot. 

It must also show how each shot or sequence is 
to be punctuated, whether by a straight cut, a fade 
or a diss olve . 

The creation of the Work Book is the responsibil- 
ity of the director. . . . 

(*ll) See I.C. 3., particularly Footnote 5, and I . C . 7 . 



-135- 



I . D. A DETAILED EXAMPLE OF PI CTURE-DRI YEN ANIMATION — 
MANY SYNTHESES OF A PULSATING HEART 



The purpose of this chapter is the clarification, through 
concrete illustration, of the approaches to the specification 
of picture dynamics that were introduced in I.B. We elaborate 
numerous techniques, mostly falling in the domain of picture- 
driven animation, for animating a pulsating heart. 

The various techniques may not produce precisely identi- 
cal sequences of frames, but they produce essentially the 
same movie, that is movies which convey the same general 
feeling. We stress how each technique facilitates a certain 
kind of control over the texture of the resulting dynamics. 
The example has been chosen for the purpose of explanation 
and not for its visual interest; such a variety of animation 
techniques are not required for a sequence this simple. None- 
theless, the techniques presented are useful in many other 
situations, and, despite their number, do not exhaust the 
possible methods of construction. 

Each technique is summarized by listing the information, 
that is algorithms, pictures, and global dynamic descriptions, 
which must be supplied to define the sequence. What is done 
directly by the animator is distinguished from what is em- 
bedded in the system. Most dynamic data sequences are repre- 
sented by static (single) pictures or dynamic (sequences of) 
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pictures. Conventions used in the diagrammatic representa- 
tion of each construction method are explained as they are 
introduced . 

Approach 1 -- The Individual Construction of Frames: 

Construction proceeds by directly sketching each new 
element of the sequence. The result is precisely what appears 
in Figure I.D.I. The "..." indicates that the tenth frame is 
followed by arbitrarily many others. To save work without 
altering the effect of the sequence, we repeat some frames; 
hence, there are only six new pictures in that part of the 
sequence shown in the figure. There is no fixed or predeter- 
mined relationship among the sizes and shapes of the first, 
second, third, fifth, eighth, and tenth frames. The animator 
has total flexibility in exercising dynamic control, for each 
frame may be varied independently, but he also must assume 
the total burden of picture construction. 

Approach 2 -- The Interpolation of Sequences of Intermediate 
Frames : 

Direct sketching is used to create certain critical 
frames of the sequence, as is shown in Figure I.D.2. The 
blank mark [- ] indicates the temporary omission of a frame. 
An interpolation algorithm, provided by the system, fills in 
the blanks. The flexibility of dynamic control depends upon 
the number of frames sketched by the animator and the variety 
of interpolation algorithms that exist in the system. (*l) 
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(1) 




[2) 



'l) The Individual Construction of Frames. 

[2) The Interpolation of Sequences of Intermediate Frames, 



Figures I.D.1-2 
MANY SYNTHESES OF A PULSATING HEART 
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Approach 3 -- The Generation of Frames from an Algorithmic 
Pes cr ipt ion : 

The animator writes, in some language, a program which 
calculates the individual frames of the sequence. { *2 ) One 
approach he might take is to factor the construction into a 
form-generating algorithm and a movement-generating algorithm. 
(*3) One program could compute the heart-shaped mathematical 
function called a cardioid. Another program could compute a 
path description, perhaps a sawtooth function, to vary the 
size of the cardioid. All frames would then be scaled ver- 
sions of a single heart shape. Within this approach, the 
animator has any kind of dynamic control that he can formally 
and precisely, that is, algorit hmically , specify. 
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!3) 




(i*) 



Picture-Driven Animat ion-- Cons truct ion of a Cel and: 
( 3 ) a Waveform, 
( k ) a P-curve . 

Figures I.D.3-4 
MANY SYNTHESES OF A PULSATING HEART 
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Approach h -- Picture-Driven Animation : 

Technique 1 -- Construction of a eel and a wavef orm, whi ch ^ i s ^ 

a static representation of a path description : 

The animator sketches a single heart shape, and a wave- 
form which defines the scale of the drawing. These are shown 
in Figure I.D.3. The symbol "®" located between them signi- 
fies that the system combines the heart form and the waveform 
to generate an animation sequence. This is done by an algo- 
rithm, embedded in the system, which is capable of varying 
continuously the size of the eel. (*U) All frames are there- 
fore scaled copies of the single heart. Dynamic control is 
exercised by refining the shape of the static structure, the 
eel, and the shape of the dynamic structure, the waveform. 
Techniques described in I.C. are used for the construction 
and modification of the waveform. 

Technique 2 -- Construction of a eel and a p-curve, which is 
a real time representation of a path 
des cription : 

Technique 2 differs from Technique 1 only in that the varia- 
tions of the size of the eel are defined by another method. 
Specifically, the scale factor is sketched in real time as 
the radial coordinate (R) of a parametric curve. The p-curve, 
which is the dynamic construction of the parametric curve, 
is shown in Figure I.D.U. Successive values of the scale 
factor are determined by the changing distance of successive 
new points of the p-curve from the origin of the coordinate 
system. (*5) Notice how the curve, of which frame numbers 1, 
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2, h, 8, 16, 32, 1+1, 50, and 60 are shown, swings out and in, 
out and in. The heart will consequently pulsate large and 
small, large and small. Dynamic control is exercised by 
mimicking one's intuitive feeling for the movement, and by 
employing other techniques discussed in I.C. 

Technique 3 -- Construction of a eel class and a time-based 
selection description : 

The animator sketches three hearts of differing size 
and shape. He specifies which of the eels is to appear in 
each frame "by constructing the graph of a selection descrip- 
tion. The graph, which appears with the eel class in Figure 
I.D.5, plots the choice of one of the three hearts against 
movie time. The system combines the display of static pic- 
ture structure on the left with the display of dynamic 
structure on the right to form a movie. The image on the 
right drives the images on the left into motion. Dynamic 
control is exercised by altering the eels or the rhythm of 
switching from one eel to the next. 

Technique h -- Construction of a eel class., a t ime- indep endent 
selection description, and a static repre- 
sentation of a rhythm description : 

All frames are again selected from the same set of three 
hearts. This time we decompose the dynamic behavior, repre- 
sented by the selection description, into the "product" of a 
time-independent selection description and a rhythm descrip- 
tion. The former is an ordered list of choices from the 
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heart set; the latter determines the intervals of time over 
which each successive choice is active. The rhythm descrip- 
tion is depicted by a static display of a pulse train. Eacn 
pulse triggers the replacement of the current image with the 
next choice on the list. Thus the animator specifies and the 
system combines the three components of Figure I.D.6. The 
representation shown in the figure defines an animation se- 
quence precisely identical to that produced by Technique 3. 
The decomposition facilitates the exercise of independent 
control over the order of appearance of eels and the rhythm 
of their appearance. 

Technique 5 -- Construction of a eel class, a time-independent 
selection description, and a real time re- 
presentation of a rhythm description : 

This technique is identical to Technique h, except we 
do not use the static pictorial representation shown there 
to define and refine the rhythm description. It is instead 
dynamically defined, tapped out in real time on a push-button. 
The reader can simulate this representation by covering the 
pulse train of Figure I.D.6. with a piece of paper, and then 
pushing the paper from left to right in real time. As 
various points along the horizontal axis are reached, such 
as the first, third, and fifth frames, new pulses appear in 
the picture . 
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Picture-Driven Animation— Construction of a Cel Class and: 

(5) a Time-Based Selection Description. 

(6) a Tirre-Independent Selection Description 
and a Rhythm Description. 

(?) a Dynamic Hierarchy. 



Figures I.D.5-7 
MANY SYNTHESES OF A PULSATING HEART 
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Technique 6 -- Construction of a eel class and a 
dynamic hierarchy : 

All frames are again selected from this set of three 
hearts. The movement is determined by a dynamic hierarchy, 
a combination of three selection descriptions and a rhythm 
description. (*6) The result is precisely equivalent to that 
achieved by Techniques 3, b, and 5. The animator specifies 
what is shown in Figure I.D,7: 

{S ,T ,S ,T ,S , . . . } is a time-independent selection descrip- 
tion which specifies that the animation sequence consists of 
an alternating selection from two subsequences of images, 
labeled S and T. 

The rhythm of the alternation is defined by the rhythm 
description, where each pulse triggers the change from 
activity S to activity T, or from T to S. 

{1,1,1,2,} and {3,3,3,3,3,} are time-dependent selection 
descriptions which define the two activities, S and T. S re- 
presents the activity of the expansion of the heart, the 
progression from the small to the medium sized heart, while 
T represents its holding the fully expanded position, the 
continued display of the largest sized heart. 

The decomposition into this dynamic hierarchy enables 
independent dynamic control over several levels of the nature 
of the picture change as well as over its rhythm. It would 
be easy, for example, to modify activity 5 and therefore what 
it means visually for the heart to expand, without altering 
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FOOTNOTES -- I.D. 



(*l) GENESYS contains no interpolation algorithms. APPL 
would gracefully accept the embedding of such 
algor ithms . 

(*2) This can he done in APPL, hut not in GENESYS. 

(*3) Note the parallel between this decomposition and 

picture-driven animation's fundamental separation of 
static picture structure from dynamic descriptions. 

(*k) Since GENESYS currently lacks this algorithm, we have 
simulated its effect hy hand. 

(*5) See Footnote k. 

(*6) Dynamic hierarchies cannot yet be established in 

GENESYS. Scale changes controlled by path descrip- 
tions (Techniques 1 and 2), p-curves whose coordinates 
may be identified with arbitrary picture parameters 
(Technique 2), and dynamic hierarchies (Technique 6) 
may be easily implemented in APPL. 
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I.E.I. CONSTRUCTION, VIEWING, AND 
FILMING MOVIES ON THE TX-2 

Three special-purpose picture-driven animation systems 
have been implemented on the M.I.T. Lincoln Laboratory TX-2 
computer. A common feature is that each has a construction 
or editing mode, a playback or viewing mode, and a filming 
mode . 

In the first mode the animator may begin work on new 
pictures and global dynamic descriptions, or may recall and 
continue the construction of pictures and descriptions saved 
from other sessions. Algorithms embedded in the systems then 
compute display files, in which sequences of frames composed 
of points, lines, and conic sections are encoded for display 
by a TX-2 cathode ray tube. 

The image files are displayed as they are computed. 
They may then be repetitively displayed by the playback 
program, which simulates a variable-speed, bi-directional, 
video tape recorder. (*l) The program normally sequences 
through the display file representation of successive frames, 
making each in turn visible for l/2Uth of a second. Con- 
tinuous cycling through the movie, or the simulation of a 
tape loop, is one useful option that may be requested. The 
animator may at any time set or alter the direction and speed 
of playback by flicking toggle switches located next to his 
console . 
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When the animator has prepared a satisfactory sequence, 
he need no longer view it directly on the scope, but may in- 
stead want to record it on film. A pin-registered movie 
camera can be mounted in a light-tight box to a TX-2 scope. 
Its shutter is always open. The filming program (a variant 
of the playback program) "paints" an image on the scope. 
After a sufficient time interval to allow the decay of the 
phosphor, approximately 1/5 of a second, a signal from the 
computer advances the camera. A return signal upon the com- 
pletion of the advance triggers the display of the next frame. 
The camera can be operated on one scope while we work at a 
tablet with another scope. Excellent film quality, with 
high contrast and low jitter, can be produced with the system. 
We can expose film at k or 5 frames per second, a rate 
limited by the decay time of the phosphor. Since the TX-2 
presently has no color scope, black-and-white movies are pro- 
duced. If full color were required, this may be obtained by 
the generation of three copies of each frame, one containing 
the red information, a second containing the blue, and a third 
the green, followed by the expensive photographic process of 
optical superposition through color filters. 
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I.E. 2. ADAM 

The chronologically first system, A Demonstration Ani- 
mated Man (ADAM), allows one to animate a crude line-drawing 
representation of a single human figure. This is done by 
specifying, via waveforms and p-curves, the seventeen path 
descriptions that define the temporal behavior of the figure's 
seventeen controlling continuous parameters. These are the 
three coordinates of the position of the body center and 
various rotation angles that determine tending of parts of 
the torso and the limbs. A model of the stick man moves in 
a hypothetical three-dimensional space; what is displayed is 
a two-dimensional projective transformation of the figure. 

The ADAM system in March of 1967 contained tools for 
specifying waveforms only. Initially all seventeen parameters 
were set to zero for all time, resulting in a lifeless man 
standing stiff and at attention. As each waveform was suc- 
cessively sketched and refined, the figure began to move. 
Complexity was added gradually--f irst t ranslat ional motion, 
then leg motion (to achieve a crude walk), then hip, torso, 
and finally shoulder and arm movements. Alternatively, one 
could begin with a particular motion (set of waveforms), and 
alter it to form a related motion. 

Surprisingly life-like walking, leaping, and flying 
motions have been synthesized. Figure I.E. 2. shows the set 
of seventeen waveforms defining the movement of a figure who 
takes five leaps forwards and then suddenly finds himself on 
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(1) 



(2) 



(1) The stick figure. That he has no head is purposeful-- 
the computer did not "drop a bit." 

(2) Seventeen waveforms defining the movement of a figure 
who takes five leaps forward and then suddenly finds 
himself on a horizontal conveyor belt moving backwards. 
The curve in the top left represents his horizontal motio 
plotted against time, the curve below it, his vertical 
motion. The second curve from the top in the second 
column represents the swinging hip movement. Motion of 
the legs is defined by the four curves in the fourth 

c olumn . 



Figures I.E. 1-2 
ADAM 
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a horizontal conveyor belt moving backwards. One frame from 
this motion is shown in Figure I.E.I. The synthesis of such 
an action was possible despite the crudeness of the system 
and even though the figure was controlled by what has proved 
to be an awkward and excessively large set of parameters. 
(See below.) Consequently beginning efforts at constructing 
movements were incredibly painful. Wi-th only a tool for 
individually sketching and resketching each waveform (super- 
imposed, if so desired, on plots of other waveforms), and with 
no prior thought or preparation, synthesizing and refining a 
motion such as the one in Figures I.E. 1-2 could take several 
hours of console time. The task became somewhat easier with 
the addition of tools for copying waveforms, and for repeat- 
ing them periodically and shifting them through time, thus 
aiding the introduction of symmetry and phase relations into 
the figure's movement. 

Movement definition in ADAM was also facilitated by the 
addition in December of 1967 of a p-curve capability. The 
translational motion of a series of leaps could be obtained 
merely by mimicking the leaps with the stylus. This was in 
fact the technique used in the animation sequence of 
Figures I.E. 1-2. 

The most interesting observation was the result of an 
accident. Just for fun, I applied to ADAM several random 
collections of path descriptions (waveforms), defined by the 
p-curve technique for use in animating EVE. Only individual 
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fragments of the resulting motions were realistic; the se- 
quences as a whole were energetic, wild, and nonsensical. 
Yet almost all movements appeared fully alive and life-like. 
Viewers perceived the movements as life-like even though 
they were obviously not physically realizable . This life- 
like quality was not apparent when all path descriptions 
were obtained by sketching waveforms. 

I regard this result as rather striking visual evidence 
of the power of clocked hand-drawn dynamics, more fundamentally, 
of the approach of the dynamic mimicking of animated behavior. 
The result is also not as surprising as it may seem. If the 
same physical, physiological, and neurological principles 
determine the "style" or "character" of the motions of all 
human limbs, then the possible dynamics of a hand movement 
would be "similar to" the possible dynamics of a leg movement. 
A mathematical model might attempt to abstract the differ- 
ences in hand and leg movements by different constant para- 
meters of equations that otherwise have the same form for 
both limbs. A paradigm for this approach is the work of 
Mermelstein and Eden, ' who, considering only the process 
of handwriting, discovered that: 

"It is found that the strokes of the writing 
may be classified into t opologi c ally similar cate- 
gories generally Independently of the writer pro- 
ducing the strokes. . .the representation of the 
letter in terms of stroke category sequences may 
be made independent of the writer as long as small 
variations are allowed for the average parameter 
values of each category." (*2) 
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The technique of editing and refining existing wave- 
forms has proved to "be a sensitive and powerful one. Slight 
modifications to waveforms resulted in significant altera- 
tions to the character of an extended interval of a movement 
--a normal walk was made into a jaunty saunter by the addi- 
tion of more bounce to the vertical coordinate path description. 
An animator working with traditional media must laboriously 
"reconstruct" each frame if he is to make such a modifica- 
tion. The addition of one more command to ADAM would allow 
one to accelerate or decelerate any "dimension" of the move- 
ment. Hence I stress once more that the use of global 
dynamic descriptions in representing movies may reduce the 
amount of repetitive labor in animation, for it may be 
quicker to modify an existing sequence through its set of 
movement descriptions than to begin construction of a new 
one. Another example of such modification, taken from the 
use of GENESYS, is depicted in Figures I. A. 5-10. 

Work with ADAM also demonstrated that the following 
should be closely intertwined — the model of static picture 
structure, the choice of representation of picture dynamics, 
ana the tools for the specification of dynamics. We noted 
before that the choice of parameters for the model of the 
stick figure has proved to be an awkward one. ADAM always 
had trouble keeping his feet on the ground— he had unknowingly 
been designed to fly. Specifically, there was no easy way to 
anchor his foot to the ground at the appropriate times during 
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a stride. The effect could only "be achieved by laboriously 
adjusting the forward motion of the body, the swinging of 
the hips, and the rotational motion of the legs. This is 
because coordinates of parts of the body were measured rela- 
tive to the body's center. If it were possible to define a 
coordinate of the foot directly, then it would be easy to 
anchor it. The particular choice of ADAM's parameters were 
well-suited for constructing swinging arm motions, but were 
ill-suited for describing a movement of stretching out the 
arm to retrieve an object, for the same reason that they 
were poor for anchoring the feet. 

The "best" choice of parameters also depends upon the 
set of techniques available for the specification of their 
path descriptions. We recall from I.C. that p-curves can 
be usefully applied to pairs of rectangular coordinates from 
a particular joint or part of a figure. P-curves could 
have better been exploited by changing the static picture 
model so that the hip position relative to the foot were 
used instead of the two rotation angles that defined the 
two degrees of freedom of a leg motion. 

More fundamentally, this reduces to a constraint satis- 
faction problem. A viable special-purpose solution would be 
to build a stick figure system in which leg motions could be 
defined in terms of variations of a redundant set of para- 
meters, including rectangular coordinates of hip, knee, and 
foot, as well as rotation angles. The system would allow 
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the assignment of path descriptions to parameters over inter- 
vals of time, and would evaluate the constraint situation 
(overconstrained and inconsistent, consistent, or undercon- 
strained and hence not well defined) existing in each inter- 
val. This computation would be straightforward for the stick 
figure model used in ADAM. 

In conclusion, it is obvious that inputting stick figure 
motions by the sketching of IT waveforms (or fewer p-curves ) 
is a technique vastly inferior to mimicking a movement while 
wearing the Computer Image harness described in I.C.3. Yet 
the harness is only a transducer which maps a real human 
motion into a collection of waveforms, and must be supple- 
mented with the capability to manipulate and modify the wave- 
forms. The ability to transform existing dynamic behavior 
and distort it at will is essential, because many cartoon 
motions cannot be mimicked or only so with difficulty — they 
are purposeful exaggerations and caricatures of real movements, 
Halas and Manvell explain this in detail: 

"The difference between cartoon animation and real 
life lies in the application of certain principles 
which are most appropriately called aesthetic. 



"As the figures in cartoon films begin to approach 
actuality more closely, the physical laws affecting 
their counterparts must be more strictly applied, even 
though they are still fantastically caricatured. The 
graphic beings in U.P.A.'s films . . . maintain an ^ 
existence which is far from actuality in their quaint 
and angular outlines. Their movements are simplified, 
mechanized, grotesque. But they are funny because they 
nevertheless bear a direct relation to the human beings 
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and animals that they caricature. Their legs may 
rotate like cog-wheels, their "bodies may glide and 
wave like cloth — but through these grot es quer i e s of 
movement shines the light of human observation, the 
comic realization of the problems of human mass and 
weight, gravity and friction, the physical laws of 
nature. The aesthetic and the physical meet on a 
sublimated plane of comic imagination. . . . 



"• • . It is fruitless, uneconomic, inartistic 
and very exasperating to undertake the laborious 
process of animation in order to tell a story in a 
manner which could be achieved just as well or even 
better through a live-action film. A cartoon's vir- 
tues lie in simplification, distortion and caricature. 
It distorts for its own purpose and affects both 
character and behaviour. It observes the physical 
laws of nature only to defy them. It conforms wholly 
to naturalism at its peril, because it then invites 
comparison with something fit to be reproduced only 
by the live-action camera. As the animator draws 
away from naturalism the powers of his medium increase; 
there is nothing but the limits of his imagination and 
his technical resources to hold him back." (*3) 
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I.E. 3. EVE 

The chronologically second system, Evolving Visual 
Energy (EVE), allows one to animate in two dimensions a set 
of points linked by "rubber "band" straight lines, which we 
call the "serpent" or snake." Except for the picture "being 
animated, the EVE system is identical to the ADAM system, 
for it was in fact grafted and grown out of the latter. 
Seven points move together under the application of one 
planar motion, defined by one p-curve or two waveforms. 
Each point also executes an independent relative motion. 
These are defined by seven p-curves, or fourteen waveforms. 
Thus the movement of each point is the sum of the movements 
produced by the main driving function and its own individual 
driving function. The seventeenth waveform defines the 
scale, or size, of the snake and the scale of the local 
driving functions. It is also possible to couple the rela- 
tive motions of the points. 

EVE is an exercise In abstract dynamic art constructed 
to illustrate the simplicity and power of applying a dynamical- 
ly sketched parametric curve, or p-curve, to define a movement, 
The motion of the stylus is immediately mirrored in some 
aspect of the dynamic of the snake. One is in some sense 
executing a "sculpture in time," or generating dynamic 
sculpture. Complex, interesting, and "beautiful" movements 
have been achieved with a system again limited to the manipu- 
lation of path descriptions. A movement appears to exist in 
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(3) 





(?; 



(h) 



(3) A pair of snakes (rumored to be preparing for a long sea 
voyage with, among others, a pair of crocodiles). 

(h) A typical parametric curve (the last frame of a p-curve) 
involved in the definition of a snake motion. Notice how 
smooth and graceful the movement is. Observe how points 
cluster at pauses in the motion. 

(5) A waveform depicting the temporal behavior of one 
coordinate from a p-curve similar to that shown in Figure 
I.E.U. 



Figures I.E. 3-5 
EVE 
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I.E.U. GENESYS -- THE GENERALI ZED-CEL ANIMATION SYS TEM 

The chronologically third system, unlike the first two, 
is more than an experiment. Although it too is a special- 
purpose animation system, it is versatile enough to he used 
in the generation of a "broad class of two-dimensional dynamic 
images. This section fills in remaining details about the 
operation of GENESYS that have not been discussed in pre- 
vious chapters. 

GENESYS contains three basic types of commands, those 
that : 

(1) Generate and modify static pictures; 

(2) Define and refine global dynamic descriptions; and, 

(3) Save and restore static and dynamic picture data, 
structure the display of existent pictures (includ- 
ing their playback), and set and change various 
modes of system operation. 

Unlike ADAM and EVE, GENESYS allows the animator to construct 
his own static images by sketching them free-hand. 

Two of these modes affect the meaning of all operations 
upon static pictures, frame-mode, in which each picture is 
assigned to a unique frame, and eel-mode, in which each pic- 
ture is assigned to a unique eel in a unique eel class. 
Specific commands set the mode and the current pictorial 
context of the system. Thus, following the command 
"EPITFRAME 5;", any newly-sketched picture is made part of 
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This picture, "drawn" by the author illust r at « the varie ty 
of line and texture that may be included in a ™ESYS eel as 
of December, 1 9 68. Free-hand sketches are port r ay ^ ^^ 
spaced at an arbitrary, user-controlled density. Straight 
lines can be solid or can be dotted, over the same range o, 
densities. Sections of circles, ellipses, parabolas, and 
reZllr ploygons may be included. Arbitrary suhpictures may 
he copied, translated, rotated, and scaled along two mdepend- 



ent dimens ions . 



Figure I . E . 6 
PICTORIAL FRAGMENTS FROM GENESYS 
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the fifth frame. Furthermore, following the command 
"FCRMCEf. 5 in tkz dla.&£> P. HEAD;", a new sketch is assigned 
to the fifth eel in the eel class named 'P. HEAD 1 . A selec- 
tion description associated with the eel class determines in 
which frames the eel Is visible. All pictorial operations, 
such as additions, deletions, and transformations, are essen- 
tially identical In frame-mode and eel mode, hut apply to the 
current pictorial context associated with the active mode. 
The animator may sketch, copy, translate, rotate, re- 
flect around axes, and scale two-dimensional suhpictures con- 
sisting of points, straight lines, and conic sections. Free- 
hand sketches are displayed as a trail of dots whose density 
is under user control through a number of toggle switches. 
He may erase by "picking up," or pointing to, individual 
picture elements with the stylus. Alternatively, he may 
request that the last pen stroke of a sketch be deleted or 
the entire context cleared. A variable-density rectangular 
grid is an aid to constructing regular line drawings. If 
the grid is activated, then the endpoints of all new straight 
lines will he constrained to lie on grid locations. The 
construction of the solid and the dotted straight lines in 
Figure I. A. 13. was simplified by this feature. Arbitrary 
projective transformations may be directly applied to eels. 
All these capabilities are operational in the current version 
of GENESYS, and are illustrated by Figures I. A. 13. and I.E. 6. 
The techniques used are standard and well-known In the inter- 
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odiless hops across the screen, delighted with 
eation at the TX-2 console. The artist, Miss 
1 of Chicago, had little animation experience, no 
rience, a brief introduction to GENESYS, and 

using it from the author. 

selection descriptions generate the movements 
tail, legs, and body of the crocodiless. Her 

motion is defined by the two path descriptions 
scillatory waveform is the vertical coordinate, 
sloping downward the horizontal coordinate. 



Figures I.E. 7-8 
SYNTHESIS OF A CAVORTING CROCODILESS 
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active computer graphics of still pictures. 

GENESYS also contains a limited number of tools, pat- 
terned after the discussion of Chapter I.C., for the specifi- 
cation and manipulation of static and dynamic pictorial re- 
presentations of global dynamic descriptions. P-curves may 
be generated in real time with the stylus; rhythms may be 
mimicked in real time with a push-button. The system cur- 
rently expects construction of two path descriptions and 
one selection description to drive into motion each activated 
eel class. It is customary to establish a rhythm description 
marking interesting events by aligning vertical lines with 
the correct frames using a knob. GENESYS then replaces the 
lines with arrows such as appear in the middle of Figure 
I.E. 17. The complementary role of eel classes and movement 
descriptions in the synthesis of two short animation se- 
quences is illustrated by Figures I.E. 7-12. 

The refining of global dynamic descriptions often pro- 
duces a movement with the desired quality globally, that is, 
over the duration of the sequence, but with occasional 
errors locally, that is, in individual frames. For example, 
the overall bounce of a ball may be correct, but its loca- 
tion at the instant it hits the ground may require modifi- 
cation. Local adjustments may be made in frame-mode, by 
calling up one particular frame and adjusting the values of 
the driving path descriptions in that instant only. The 
animator can also experiment with alternatives to the 
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(9) 



(10) 





(n: 



(12) 



The 1st, 7th, 13th, and 19th frames of the take-off of a 
bird are shown. The figure is superimposed on the parametric 
curve (the final frame of the p-curve) which defines its 
path through space. The animator, Mrs. Nancy Johnson of 
Waltham, Mass., has mimicked the motion by sketching the 
p-curve; the bird then reproduces this movement. Observe the 
switching among discrete shapes and positions of its eye, 
wing , and f eet . 



Figures I.E. 9-12 
A P-CURVE DEFINES A MOVEMENT 
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selections of eels from eel classes that have been made in 
that frame. Specifically, the system first displays light 
buttons (stylus targets) listing all eel classes. Whenever 
the animator points to a particular eel then visible in the 
frame, it is replaced by the next eel in the class. When he 
points to the last eel, it is replaced by the zeroth eel, 
that is the empty or invisible eel. When he now points to 
the name of the class, its first eel is again selected and 
displayed. The light buttons also serve another function. 
Pointing to a particular button "connects" two knobs to that 
eel class, such that turning the knobs will readjust the 
position of the eels belonging to that class (all the eels, 
not just the one currently visible). Further details are 
given in Figures I.E. 13-1^. 

Miscellaneous commands exist to restart the system, 
to exit from the system, to name and save an animation se- 
quence, that is a complex of eel classes and movement descrip- 
tions, to recall for further work an existent sequence, and 
to play back the current sequence. There are modes which 
determine whether straight lines are drawn solid or dotted, 
and whether a grid is activated or not, and instructions for 
establishing the density of the grid. There are commands to 
display all members of all eel classes belonging to a parti- 
cular movie, to display the movie in frame j while eel k of 
class 'abed' is under construction, to display the next or 
the previous frame, to show or hide the picture of the para- 
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(13) All eels used in the animation of Oopy--he flaps his 
ear, vinks, and sticks out his tongue-are shown superimposed. 
These sketches were also done by Mrs. Johnson. 

(lit) GENESYS is in frame-mode. The current state of a 
particular frame is displayed. Also visible are ! light- 
buttons" representing eel classes (mouth, tongue, eye, ear, 
trow). The animator may alter the current frame, switching 
the selection of a eel from a class by pointing at it, or 
changing its position by turning knobs located under the_ 
scope. The underlying movement descriptions are automatically 
updated by GENESYS. 



Figures I.E. 13-1^ 
CELS AND CEL CLASSES 
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etric curve of a eel class, and to call the editing system 
with which one refines movement descriptions. (*h) 

The system has been used in the construction of short 
cartoon and abstract dynamic sequences by several individuals 
with varying degrees of artistic skill and training in anima- 
tion. One cartoon with a particularly interesting evolution 
is described in Figures I.E. 15-18. All users were delighted 
with the responsiveness of the medium, with the immediate 
display of their animation. All were discouraged by the 
unreliability of the system. Despite numerous system 
crashes and program bugs, sequence of 5 to 10 seconds dura- 
tion were composed, often with little advance preparation, 
in 1/2 to several hours of console time. Except for that 
shown in Figures I.E. 15-18, all these sequences were exceed- 
ingly simple, and usually involved no interaction between 
objects. Undoubtedly, animation with GENESYS would be much 
faster if the system were engineered more smoothly, more 
completely debugged, and then stabilized, if the animator 
were accustomed to working with it, and if he were working 
on a longer sequence where the same eels could be used again 
and again. 
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A man, tripping blithely along, kicks a dog lying in his path. 
The dog rises and trots off to the right (shown above). It then 
returns, teeth bared (shown in Figure I.E.16), and bites the man. 
The man Jumps and runs away. The dog first follows, then re- 
turns once again to rest. The duration of the sequence is 
approximately 20 seconds. (Please turn to Figure I.E.16.) 



Figure I.E. 15 
A SHORT CART00N--WHAT THE VIEWER SEES 
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Figure I.E. 16 
A SHORT CARTOON — HOW IT WAS MADE 
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(IT) The dynamic descriptions defining Mr. Cohen's cartoon 
as of January, 19&9, are shown above. The selection descrip- 
tions, from top to 'bottom, belong to the man's head, the man's 
legs, the dog's head, and the dog's body. There are h, 8, 8, 
and h eels in each class, respectively. The two waveforms 
represent the changes with time of the horizontal coordinates 
of the man and the dog. 

(18) The man's waveform is shown superimposed on rhythm 
description representing critical instants of time. This 
display was used in the process of resketching the waveform 
to refine the dynamics of the film. 



Figures I.E.17-18 
A SHORT CARTOON — WHY IT WORKS 
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FOOTNOTES -- I.E. 



(*l) A discussion of the practical problems involved in 

achieving real-time computation and playback of anima- 
tion sequences appears in III.B. 

(*2) Mermelstein and Eden, p. 268. 

(*3) Halas and Manvell, pp. 6l-68, They explain further: 

?! 

"Exaggeration in cartoon is largely born 
of function. The gesturing parts of the body 
--legs, arms, hands, feet--demand enlargement, 
and above all so does the head, as the princi- 
pal feature in either human or animal kind. 
Within the head itself, the mouth demands en- 
largement through the gesture of speech, and 
so does the eye, because it is the most impor- 
tant means whereby mood, emotion and character 
may visually be demonstrated. 

"Finally, there is a technical reason in 
cartoon film-making for exaggerations and 
simplifications. When drawings have to be pro- 
duced in large numbers and by various hands, 
some form of graphic economy through the empha- 
sis of certain characteristics is essential to 
enable the nature of a figure to be maintained 
without any unwanted deviations which would be 
likely to confuse the clear markings of charac- 
ter. 

ti 

"When inanimate objects assume life in the 
pursuit of humour, the need for exaggeration be- 
comes even more pronounced. For example, the 
cartoonist may want to give an automobile the 
characteristics of a dog in its attitude to the 
fuel that its owner offers it. When it shakes 
its shaggy head in refusal to tank up with the 
wrong brand of spirit, then the whole body of 
the car must shake like a neurotic Saint-Bernard, 
and its head-lamps must become great eyes filled 
with a pathetic dismay. 

"in instructional films where comic exaggera- 
tion is needed for some emphasis of fact, even 
diagrammatic models may be permitted to acquire 
human or animal personalities, though exaggeration 
of this kind is only used to help make some 
important teaching point. 
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"Visual symbols may have to be introduced, 
to emphasize what cannot in real life be seen 
but only felt. The wind may enter the action 
in the form of the moving lines familiar in the 
strip cartoon; hot and cold may also require 
some kind of symbolic indication made by lines 
which surround a figure in order to indicate 
shivering or sweating. The exaggeration here 
lies not only in the experiences shown through 
the reaction of the characters, but in the way 
the graphic symbols are introduced and animated. 

"The basic aesthetic principle in cartoons 
of graphic distortion is supplemented in enter- 
tainment cartoons by the fun that can be had at 
the expense of the physical laws of motion. 
The exploitation of actions which go beyond all 
normal physical possibilities in the real world 

have a powerful effect on any audience. 
tt 

"Time is also a plaything in the cartoon-- 
an action can be speeded to such a degree that 
round the world in eighty days becomes round the 
world in as many seconds. The chase motif of 
movie drama develops into a paroxysm of speed 
with a fine graphic flourish in per spe ct ive— 
the minute dots on the horizon hurtle with 
rhythmical abandon into vast blown-up propor- 
tions in the foreground all within three or four 
seconds. The cartoon uses slow motion far less 
than quick because its peculiar dynamic usually 
makes it move faster than life in everything 
it do es . 

"For instructional animation, however, a 
slow speed is often desirable; the stripping 
down of a complex diagram to its inner sections 
may well require a slower-than-lif e rhythm--that 
is, were the sections of real machines being 
lifted apart for inspection. The diagram un- 
peels in synchronization with the commentary 
to meet the demands of clear and well-timed 
exposition. 

[*k) Seeing frame j while constructing eel k of the class 

'leg 1 facilitates drawing a position of the leg so that 
it kicks the soccer ball in that frame. This illus- 
trates one feature of GENESYS designed to combat the 
problem, discussed extensively in I.C.7. and I.C.8., 
of relating the simultaneous motions of several objects, 
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I.F. CONCLUSION — THE REPRESENTATION OF DYNAMIC INFORMATION 
-- THE CONCEPT OF A DYNAMIC DISPLAY 



Thus the essence of picture-driven animation is: 

(1) That one may formally isolate aspects of picture 
change which recur over extended intervals of time, and de- 
fine picture-transforming algorithms which produce this 
change ; 

(2) That there exists a set of abstractions of dynamic 
information, data sequences which drive these algorithms to 
produce a large and Interesting class of animated displays; 
and , 

(3) That these abstractions may in turn "be modeled, 
generated, and modified by static as well as animated pic- 
tures, modeled in the sense that the picture structure 
represents the data sequence, generated and modified in the 
sense that the picture represents the process of synthesis 
as well . 

The three kinds of dynamic descriptions constitute a 
rich, expressive, intuitively meaningful vocabulary for 
dynamic s . Each type abstracts an important category of 
dynamic behavior-- f low and continuous change (path descrip- 
tions), switching and repetitive choice (selection descrip- 
tions), and rhythm and synchrony (rhythm descriptions). 
The vocabulary is economical, flexible, and general in the 
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sense that it can characterize the dynamic similarities that 
exist in seemingly diverse animation sequences. 

The use of dynamic descriptions couples picture defini- 
tion by sketching and "by algorithm; it furthermore allows 
both local (of the individual frame) and global (for an 
interval of time) control over dynamics. We have chosen to 
stress the latter and adopted the term ''global dynamic descrip- 
tion," for it is the capacity for global control that results 
uniquely from the use of the computer as an animation medium. 
Yet a dynamic description is not only a representation over 
an interval, but a sequence of single elements whose modifi- 
cation also provides local control over individual frames. 
Both local and global control are vital to the successful 
synthesis of movement. He who accidentally crashes into a 
wall while running from the police is going from the contin- 
uous to the discrete, from a global motion to a local event. 
He who aims to scale the wall is interpolating the continuous 
between the discrete, adjusting the global to fit the 
constraints of the local. We have seen how GENESYS facili- 
tates global control {Figures I.E. 8-12) as well as local 
control (Figure I.E.lU). 

The naturalness and power of the vocabulary is increased 
by the ability to manipulate it in an interactive graphics 
environment. There exist, for each kind of data sequence, 
static pictorial representations such as the waveform and 
the parametric curve which provide a global view of and 
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facilitate precision control of the temporal behavior implied- 
ly the sequences. There exist, for each kind of data sequence, 
methods of dynamic specification such as the clocked sketch- 
ing of a parametric curve and the tapping of a rhythm which 
allow the animator's sense of time to be transmitted directly 
through the medium of the computer into the animated display. 
We use the term "global dynamic description" and the names 
of the three types somewhat loosely in referring both to the 
underlying dynamic data sequences and to their corresponding 
pictorial representations. The imprecision is purposeful, 
for it is very significant that, in an interactive graphics 
environment, one can easily traverse in either direction any 
leg of the triangle {Dynamic Data Sequence, Static Pictorial 
Representation, Dynamic Pictorial Representation}. What 
results is an important plasticity in the representation of 
dynamic s . Characterizations of change can be manipulated 
(shifted, stretched, superimposed, . , .) within and between 
the domains of the static and the dynamic. Several animation 
sequences can readily be related, coordinated, or unified, 
regardless of whether or not they ever occur concurrently. 
Dynamic behavior (data) can readily be transferred from one 
animation subsequence (including the animator) to another, 
from one mode of representation or embodiment in a picture 
to another . 

Our concept of a dynamic display is a broad one, and 
purposely so. For as we stress in Part II, a computer- 
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a 



mediated display is not only wh»t. is visible lout what Is 
contained in its model in th e computer system. And the system, 
i.e., an interactive animation system, includes not only 
disks and core but an animator and perhaps an ongoing physics 
experiment as well as a tape-recorded speech. This system 
evolves continually through real time. Occasionally there 
occurs a particular reorganization of the system which re- 
sults in the transfer of information from the animator to the 
pictorial data base, or in a computation on the data base 
which results in a sequence of visual images, that is, data 
directly convertible by hardwar e . int o visual images. Thus, 
we have stressed before, the act of mimicking dynamics is 
(user-driven) dynamic display. This unification of the 
roles of picture and action, as equivalent components of 
displays, is important . A flexible interactive computer- 
mediated animation system must model the animator and his 
actions (input), dynamic data (storage), and static and dyna- 
mic pictures (output) as interchangeable representations of 
movement and rhythm, all mediated by the computer through 
its store of algorithms to produce animated system behavior. 

The greater is the number and generality of available 
models of pictures and of processes of picture construction 
(actions), the more flexible and powerful is the animation 
system in its ability to deal with dynamic information. The 
previous chapters summarize our experience with special-purpose 
animation systems that present the user with a fixed set of 
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such models. The multi-purpose language of Part II allows 
the animator himself to synthesize new models. 

With such a language one can describe arbitrary action- 
picture interpreters that extract dynamic descriptions from 
the animator^ use of system devices and transform them and 
existing static and dynamic displays into new static and 
dynamic displays. In Part I, particularly in I.C., we have 
seen some simple yet useful examples. Two others follow: 

(1) Another recent innovation at Computer Image 

2 9 
Corporation is a technique that converts a speech waveform 

into the appropriate selection description to drive a pic- 
torial model for the mouths of cartoon characters. The data 
sequence selects from among seven standard mouth shapes and 

positions, which may be found in typical animation handbooks 

3 
such as Halas and Manvell. Some observers have claimed that 

this is done so well that one can identify the language that 

is being spoken by observing only the visible movements of 

the mouth. Their interpreter which carries out this task 

has been implemented in hardware, but the goal, transforming 

dynamic information from one representation to another, is 

the same. 

(2) A second potential application is multi-animator 
animation, A program could interpret the actions from var- 
ious sets of devices (styli, togs, etc) and the pictures on 
numerous scopes. Several animators could mimic interesting 
roles, aiding the achievement of the desired pacing, give- 
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and-take, and synchrony required for certain classes of 
films . 

Finally, the use of dynamic descriptions helps estab- 
lish a conceptual framework which facilitates efficient use 
of the resources of the animation system: animator, soft- 
ware, and hardware. The process of animation may easily be 
factored into the synthesis of various dynamic strands. 
We shall see in III.B. that a sequence will be constructed 
in multiple passes in which the computation of some strands 
can aid the later synthesis of other strands. The repre- 
sentation of dynamics by pictures has a valuable by-product 
— all system tools for the construction of animation images 
may be made applicable to the specification of dynamic infor- 
mation. And, lastly, we shall present, in Chapter III.B., 
hardware additions suggested by the utility of movement de- 
scriptions, additions which when incorporated in an animation 
scope should reduce the overall cost of computer-mediated 
animation. 
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We have seen that there are advantages and. disadvantages 
to each of several approaches to the definition of dynamic 
pictures—the construction of individual frames, the algo- 
rithmic generation of sequences of frames, and picture-driven 
animation. This suggests that a flexible animation system 
would allow the harmonious blending of all these techniques. 
Here GENESYS fails a priori, for it makes inaccessible the 
full computational power of the computer. Within the language 
of GENESYS one cannot implement algorithms by writing programs. 
We have also seen that the GENESYS is inadequate because it 
presents the animator with a fixed set of commands and tools, 
with fixed mechanisms of control, and with fixed models of 
pictures and of processes of picture construction. A suit- 
ably skilled animator may himself determine these aspects of 
his animation system, his animation-machine , only if the 
system is not a fixed set of commands but an extensible, 
truly open-ended programming language. 

Strong constraints need be applied to such a language. 
Its domain of discourse must include algebraic computations, 
the manipulation of structured data and pictures, the genera- 
tion of displays, and the monitoring of user interaction. 
Yet, unlike most programming languages, it must develop 
these constructs in a clear and simple manner that is har- 
monious with a layman's intuition about pictures and the 
construction of pictures. (By laymen we mean animators, 
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artists, educators, not pro|r«n»rB.) Tkm design Off * 
language wfciea seeks to »*at tk*#* goal* i* o«*li»*4 in 
Fart II of th* dissertation. 
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II. A. 1. THE ESSENTIAL FEATURES 

OF SKETCHPAD, BEFLIX, AND CAFE 

The purpose of this chapter is further to motivate aspects 
of the design of an open-ended, multi-purpose interactive 
computer-mediated animation system. The system components 
that enable interactive computer-mediated animation were de- 
tailed in Chapter I. A. and are restated briefly here: 

(1) a general-purpose digital computer; 

(2) a hierarchy of auxiliary storage; 

(3) an input device which allows direct, real-time, 
drawing to the computer in at least two spatial 
dimens ions ; 

(k) an output device which allows direct ^real-time, 
viewing of animated displays; 

(5) a "language" for the construction and manipulation 
of static pictures; 

(6) a "language" for the representation and definition 
of picture change and the dynamics of picture 
change ; 

(7) mechanisms for converting the specifications of 
static picture structure and picture dynamics into 
a sequence of visual images; and, 

(8) mechanisms for storing, retrieving, and displaying 
this sequence of visual images. 

Yet such a description provides only a general founda- 
tion upon which specific designs can "be hased. Several con- 
crete realizations, special-purpose animation systems, were 
described in Chapter I.E. Guidelines for a more general and 
comprehensive approach emerge from experience with these 
systems and from the experience of others. We shall therefore 
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discuss in some detail three particularly interesting and 
relevant pieces of work: SKETCHPAD (1963), the first syste- 
matic and comprehensive system for on-line graphical man- 

39 
machine communication; BEFLIX (196J4}, the first programming 

language for computer animation; ' and CAFE (1968), an on- 
line typewriter-controlled animation command language. The 
The design of APPL, a new Animation and Picture Processing 
Language, draws heavily upon observations about SKETCHPAD, 
BEFLIX, CAFE, and GENESYS. 

SKETCHPAD is significant because it presented numerous 
techniques for man-machine graphical communication which 
were based upon some powerful new abstractions. SKETCHPAD 
demonstrated that the computer could be an active partner In 
the processes of sketching pictures and defining their 
structure. A command language of demonstrative light-pen 
movements and push-button signals Is used to control the 
construction and selective deletion, replication, and modifi- 
cation of picture parts. Geometrical relationships can be 
imposed implicitly through the application of constraints, 
such as the parallelism of lines or the colinearity of points. 
Thereby SKETCHPAD can turn certain sloppy sketches into 
precise ones. SKETCHPAD stores explicit information about 
the topology or structure of pictures. This facilitates the 
specification of complex commands through the recursive appli- 
cation of a simple command (such as "move") on the various 
elements of a hierarchic picture structure. 
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Economy in the effort of picture construction is aided 
by repeated use of existent pictures and structures. The 
copy function duplicates pictures and constraints and leaves 
the copies free for arbitrary modifications. The in s t anc e 
function also duplicates pictures, however allows the copy 
to differ from the master in position, orientation, and scale 
only, and preserves the link between them such that changes 
in the master are reflected in changes in its instances. 

Yet in his ability to model, assemble and disassemble, 
and name picture structures, to undo the effect of previous 
operations, and to extend the effective command power of the 
system, the SKETCHPAD user is quite limited. Four sources of 
these limitations are now suggested: 

(1) SKETCHPAD is not a programming language. It is a 
command language, in which each command is executed as soon 
as it is invoked, and thus at each step the user determines 
the flow of control from command to command. The exception 
is in the application of constraints, in which SKETCHPAD 
simulates a descriptive (non-procedural) language capable of 
solving certain implicit specifications of picture geometry. 
However, the user cannot command SKETCHPAD to compute an 
arbitrary function on pictures. 

(2) SKETCHPAD is a fixed system of commands, a closed 
system, lacking the capacity for definitional extension of 
the command structure, or the hierarchic definition of new 
concepts in terms of existent ones. Only sets of data items, 
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picture and. constraint complexes, may "be coalesced and used 
as units. The instance simulates a procedure-writing capa- 
bility that is restricted to programs that generate fixed- 
geometry subpictures, and whose four parameters are the horizon- 
tal and vertical positions, the orientation, and the scale. 
Instances cannot simulate the effect of procedures that 
generate variable-geometry or-topology pictures. Yet instances 
are the only structures that may "be embedded hierarchicly to 
arbitrary depth. 

(3) The allowable topology or structuring of pictures 
is built into the system and is often not general enough or 
powerful enough. Relationships between arbitrary picture 
elements can only be established by including them in the 
same master picture, yet an element can only be a member of 
one master. The characterization of pictures is too dependent 
upon what is required for their immediate display. The ability 
to change a picture is too dependent upon the structure imposed 
during picture generation. It may therefore become difficult 
to undo or alter what one has done. I.E. Sutherland noted 

that "... there is a definite need for a general-purpose 

39 
function for making topological changes to a drawing...." 

What is required is a richer user language for establishing 
and manipulating picture structure. 

(U) Finally, the ability to name and retrieve picture 
parts is limited in SKETCHPAD to pointing and to the designa- 
tion of numbers assigned in the course of picture construction. 
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There is no way to isolate subpictures by a citation of their 
identifying properties, hy an implicit description such as 
'all those picture parts to the left of the rectangle and inside 
the circle.' One source of rigidity in making picture changes 
is the difficulty of naming through enumeration all the sub- 
pictures involved in the change. 

BEFLIX's significance stems from its pioneering of the 
use of the computer in animation and its existence as the 
first programming language for the specification of picture 
dynamics. (*l) A written language embedded in MACRO-FAP, 
BEFLIX constitutes an open-ended system which may be extended 
by the user. The animator constructs a picture by symbolically 
paointing intensities on rectangular elements of one of a 
number of finely-divided surfaces or rasters, and directing 
an imaginary camera at a particular surface. This causes a 
picture of the surface to be recorded on microfilm. After . 
the picture is modified to form the next frame, the camera 
again records its state. A movie can be made by repeating 
this cycle. 

The language consists of a "scanner language" and a 
"movie language." With the scanner language, the user mani- 
pulates bugs or scanners over the picture raster, performing 
tests on the positions and the intensities of the covered 
elements. The results of these tests determine subsequent 
changes to bug positions and element values. With the movie 
language, most of which was implemented in the scanner language, 
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one controls the output or temporary storage of pictures, 
performs static or dynamic drafting operations, and modifies 
the contents of rectangular areas. Dynamic operations are 
interrupted during the output of intermediate frames. The 
operations upon rectangular areas provide powerful control 

over texture, a feature exploited to advantage in the BEFLIX 

21 
films of Vanderbeeck . 

CAFE is a command language for the on-line construction, 
editing, and display of figures consisting of collections of 
straight line segments. The work, like ours, has been carried 
out within the past two years at the M.I.T. Lincoln Laboratory. 
"On-line" in CAFE means typewriter communication in a time- 
shared environment. Static pictures are constructed by in- 
voking commands to assign coordinates to points and lines, 
and then group them into "objects" and further into composites 
called "graphs." Graphs are further grouped into dynamic 
units called "elements," each of which has its own independent 
motion description. A motion description is defined by speci- 
fying a sequence of "scenes." Each scene has its own time 
interval, and consists of a sequence of translations, rota- 
tions, and scale changes. The motion of elements may be 
related by establishing a hierarchic dependence, causing one 
element to follow another (add the second element's motion to 
its own). Picture and scene descriptions are kept symbolically 
for further modification. Output is either to a microfilm 
recorder or to a scope for direct viewing, but the environment 
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II. A. 2. SOME SPECIFIC ISSUES RAISED 
BY BEFLIX, CAFE, AND GENESYS 



Several comparisons of BEFLIX, CAFE, and GENESYS are 
relevant to the design of a new computer animation system: 

(1) BEFLIX's off-line operation and CAFE * s on-line 
typewriter control contrast sharply with the direct graphical 
communication of SKETCHPAD and GENESYS. ( *2 ) Ways to exploit 
an interactive environment in animation have "been developed 
in Part I of the dissertation; Part II explains how APPL's 
design facilitates the flexible application of these concepts. 

(2) BEFLIX and CAFE differ significantly in the power 
of the resulting animation language. BEFLIX is a complete 
programming language in which one can in principle express 
any computable function. Macro-definitions, which may be 
nested to arbitrary depth, allow definitional extension of 
the command structure of the language. CAFE and GENESYS are 
command languages, incapable of expressing arbitrary comput- 
able functions. Like any good on-line system, CAFE allows 
the saving, copying, and modification of files describing 
particular static pictures and the scenes that generate dyna- 
mics; GENESYS allows the saving, copying, and modification 

of pictures and dynamic data sequences. Hierarchies of CAFE 
files, which could simulate nested calls of picture-defining 
subroutines, cannot be established. Thus, as in GENESYS, 
definitional extension is impossible; the command structure 
is fixed. 
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(3) BEFLIX, CAFE, and GENESYS differ in the mechanisms 
of control they provide over the temporal dimension. The 
BEFLIX animator specifies an algorithm that determines the 
picture at successive instants of time. The CAFE animator 
defines an ordered succession of scenes, specifying the dura- 
tion of each one and the set of transformations to he applied 
during that interval. The GENESYS animator defines, through 
the sketching, mimicking, and graphical editing of pictures, 
data sequences that control movement and rhythm in an anima- 
tion sequence. Only in BEFLIX can the lengths of phases of 
the activity or the nature of the constituent picture change 
be made to depend upon a computation of some aspect of the 
sequence; in CAFE and GENESYS this must all he expressed 
explicitly in advance. 

( h ) Two kinds of picture change occur in the process 
of animation; one yields successive stages in the construc- 
tion of a static picture, the other produces the actual dyna- 
mics to be recorded on film. In BEFLIX one language is used 
for both tasks. The effect of a sequence of statements that 
alter a picture depends upon whether or not the instructions 
are accompanied by "camera" calls, whose result is the output 
of frames to the microfilm recorder and the advance of movie 
time. If camera calls are included, a dynamic sequence is 
formed; If there are no camera calls, a new static image is 
formed. In CAFE and in GENESYS, on the other hand, there is 
a strict separation between static picture definition and 
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the imposition of dynamics. Thus there are in CAFE two opera- 
tions which translate pictures, a shift command (static) and 
a move command (dynamic). 

(5) Finally, there is the significant issue of 
parallelism or the description of concurrent dynamic activity. 
BEFLIX is a language with strictly sequential or explicit 
flow of control, including transfer of control through standard 
mechanisms of subroutine calls. Camera calls must he moved 
within the program if additional concurrent picture changes 
are added, CAFE and GENESYS allow the independent definition 
of concurrent strands of dynamic activity, parallel actions in 
a scene, allowing new strands to he specified without altering 
exi st ent ones . 

Our conclusions are that we desire: (l) direct graphi- 
cal interaction; (2) an extensible programming language; 
(3) flexible control over the dimension of movie time; (k) 
unique mechanisms for producing picture change; and, (5) the 
independent definition of concurrent strands of dynamic 
activity. These and other criteria in the design of APPL 
are expanded in the next section. 
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II. A. 3. ESSENTIAL FEATURES IN THE DESIGN OF APPL 

This background has motivated the following aspects of 
the design of APPL, a new Animation and Picture Processing 

Language : 

(1) Like any interactive computer graphics system, APPL 
contains commands which are immediately executed when desig- 
nated. These commands can also be grouped into procedures 
whose execution is delayed until the name of the procedure 

is activated. 

(2) APPL is capable of definitional extension, through 
the nesting of these procedures to arbitrary depth. To 
facilitate the nested and recursive application of procedures, 
they are allowed to take arbitrary numbers of parameters, and 
reasonable conventions regarding the scope of variables and 
the sharing of procedure data are adopted. 

(3) APPL is a complete programming language, in which 
it is possible to express any computable function, as well 
as powerful animation and picture processing operations. It 
attempts to achieve these goals in the simplest, most direct, 
and most general way possible. Thus, included in the base 
system are only one distinct numerical data type, the SCALAR, 
and one distinct pictorial data type, the POINT, augmented 
by powerful mechanisms for aggregating these units and for 
defining complex picture types in terms of simple ones. 

These three criteria guarantee that the system is open- 
ended in such a way that significant extensions to the 
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command structure may "be expressed -within the system. The 
continuity between immediate execution mode and procedure 
definition mode, characteristic of conversational, JOSS-like 
languages, should aid the system utilization of those with 
little or no programming experience, for portions of poten- 
tial programs can easily "be tested as they are devised. 
(*3) 

(h) I. A. 2. proposed that a single set of APPL commands 
produce the picture change that sometimes yields successive 
stages in the construction of a static picture, and that 
other times yields successive frames to he included in the 
movie itself. These commands are called PICTORIAL OPERATIONS. 
They cause the introduction, replication, and deletion of 
pictures, and the modification of both their directly visible 
properties, such as location and intensity, and the structure 
of their internal representations such as pi ct ur e-subpic tur e 
relat ionships . 

(5) Picture changes that result in dynamic sequences 
must be organized with respect to a scale of movie time or 
simulated time . APPL contains mechanisms to trigger and 
control the passage of movie time. Because the user may 
interrupt the passage of movie time, and may start and stop 
it at will, these mechanisms are more complex than the cor- 
responding ones in BEFLIZ. 

(6) APPL provides for the definition and use of global 
dynamic descriptions within the framework established for 
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controlling the passage of movie time. The desired goal is 
the flexibility and plasticity in representing and using 
dynamic information that was discussed in I.F. Therefore, 
commands that construct and manipulate pictures of dynamic 
descriptions are implemented via definitional extension of 
the language, so that their meaning can easily he changed by 
the user . 

(7) The animator is as an integral component of 
animated system behavior. APPL includes constructs for 
monitoring the animator's use of the stylus, toggle 
switches, push buttons, and other devices. This aspect of 
the language design must be clean and simple, for it will 
be used to construct the control features of interactive 
graphical procedures. If large parts of an animation system 
are their implemented via definitional extension, the animator 
can easily control his style of interaction with the system. 
(*h) 

(8) APPL allows quasi-parallel flow of control during 
the passage of movie time. This facilitates the independent 
specification of the parallel dynamic strands representing 
concurrent activities of several objects in one movie. 
Mechanisms exist for communication between programs imple- 
menting these activities. We distinguish between the master 
copy of a program and its use, or activation as part of an 
animation sequence. Several instances of one program may 
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run concurrently through an interval of movie time. 

(9) The ability to impose structure on pictures is 
provided by the language. A data structure called the 
AGGREGATE facilitates the modeling of global dynamic descrip- 
tions and of complex sequences and hierarchies of pictures. 
The APPL user can define new picture types as structured 
composities of existing picture types; recursive definitions 
are allowed, 

(10) APPL allows the user to talk about the characteris- 
tics of pictures. Pictures are characterized by a set of 
ATTRIBUTES, including 'type', taking on values called 
PROPERTIES. The user can enlarge the set of picture attributed 
by definitional extension of the language. When a picture 
possesses certain properties, this will be said to define a 
picture state. Tests for the existence of picture states, 
called pictorial conditions, will control the evolution of 
an animation sequence. 

The last two criteria guarantee that a rich picture 
description capability may be implemented via definitional 
extension of APPL. There may be developed a coherent family 
of animation languages, all grown from the common base , or 
core language , each uniquely suited to the manipulation of 
a particular kind of picture, and each capable of being made 
still richer through further extension. (*5) 
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II.A.1+. A SCENARIO ILLUSTRATING SOME USES OF APPL 

To illustrate the process of animation in an interactive 
programming environment, we present a scenario. The example 
could "be executed with a system that is an extension of the 
APPL base language described in the following chapters. 
Specifically, we assume that the "base language has been 
extended so that it provides a capability for picture-driven 
animation such as exists in GENESYS . What follows is in- 
tended as a general picture of how APPL may be applied, and 
therefore does not indicate all of the specific mechanisms 
necessary to create the effects described. 

The animator , having completed ' SPROINGBOINGZAP ' as 
described in I. A. 3., desires to experiment further with the 
motif of a moving triangle . Specifically, he intends to con- 
struct various static patterns and textures composed of 
triangular parts, and then use these as backgrounds and masks 
against which and through which a few dynamic triangles dance 
and cavort. Therefore, he will extend APPL to facilitate 
the construction of triangles and patterns formed of 
triangles, and the definition of both isolated and coordin- 
ated movements and deformations of collections of triangles. 
(*6) 
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How it is don e : 

Step 1-- The construction of a single triangle, fir st by the 
animator, then by t he system : 

USER(U) : CALL APPL; 

APPL(A): HELLO, THIS IS APPL; 

(APPL is entered at the "command mode' 1 level. Designat- 
ing a command while the system is in this mode causes its 
execution to begin immediately.) 

U: tiEWPT PT.A at ... ; 

(After activating the command NEttVT , and entering a 
name for the point, 'PT.A 1 , the animator touches the stylus 
to the location whose x coordinate is 0.0 and whose y 
coordinate is 0.2. ( *7 ) A point is created at that location.) 
U: HEW?T PT.B at ... ; 
U: WEWPT PT.C at ... ; 

U: CONNECT PT.A to PT,B; 

(After activating the command CONNECT, he points at the 
two points named PT.A and PT.B. Since APPL expects points 
as arguments for the command, these have become active targets 
for the stylus. A line then appears between PT.A and PT.B.) 

U: CONNECT PT.B to PT.C; 

U: COHUECr PT.C to PT.A; 

(Construction of the triangle is now complete.) 



-200- 



(Rather than carry out this sequence of steps whenever 
a triangle Is to be constructed, the animator will extend 
APPL so that it aids future construction.) 



(He invokes the system meta-command PEF7WE, and enters 
' BUILDATRIANGLE ' as the name of the command to "be defined. 
This puts the system in "definition mode." When a legal 
command is now designated, it is not immediately executed, 
but rather placed in an ordered, numbered, list of commands 
whose execution is delayed until later activation under the 
command name BUI LVATRl ANGLE . ) 



U: 



PEFIWE BUILDATRIANGLE; PROGRAM #1 

.01 NEWVT PT.A at 0.0,0.2; 

.02 NEitfVT PT.B at 0.1,0.0; 

.03 WEWP7 PT.C at -0.1,0,0; 

,0U CONNECT PT.A to PT.B; 

.05 CONNECT PT.B to PT.C; 

.06 CONNECT PT.C to PT.A; 

ENV; 

(The definition, whose conventions are explained in more 
detail In II. B. 2., is terminated by the system met a-command 
ENV . Now there is a new APPL command; the animator checks 
its meaning by activating it.) 

U: BUI LVATRI ANGLE; 

(A triangle, identical to the one constructed before, 
appears in the working area of the scope. Thus, APPL has 
been extended to Include a tri angle- cons truct i on command.) 
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Step 2-- The construction of two APPL programs which aid the 
interactive generation of more triangles : 

(BUI LVATRl ANGLE is useless, for it always constructs the 

very same triangle. Hence the program is now made a paradigm 

for defining two new commands which will aid the generation 

of many triangles.) 

U: 



PEFINE FORMTRIANGLE among PT.l and PT.2 and PT.3; PROGRAM #2 

.01 CONNECT PT.l to PT.2 

.02 CONNECT PT.2 to PT.3 

.03 CONNECT PT.3 to PT.l 

ENV- 



(Suppose that PT.D, PT.E, and PT . F are arbitrary points 
visible on the scope. To check the definition of the new 
command, the animator selects these three points with the 
stylus, thereby designating them as parameters for 
FORMTRIANGLE. ) 

U: FORMTRIANGLE among PT.D and PT.E and PT.F; 

(The three points are automatically connected to form a 
triangle . ) 



U: 



VEE1NE DRAWTRIANGLE; 



PROGRAM #3 



. 01 
.02 
.03 
.0k 

ENV; 



NEWVT PT.U at STYLUS: 
NEWPT PT. 5 Ott STYLUS; 
NEWPT PT.6 at STYLUS; 
FORMTRIANGLE among PT.1+ and PT.5 and PT.6; 
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(This program differs from the others in two ways. 
First, it includes a command itself defined by another pro- 
gram, thereby demonstrating APPL's open-ended character noted 
in II. A. 3. Once defined by language extension, a command is 
indistinguishable from those included in the base language, 
except that its meaning can easily be changed. 

Second, the program includes a command whose argument 
must be supplied by the user during execution. Before generat- 
ing a point, the system waits for the stylus to be positioned 
on the tablet surface, just as it waits for an argument when 
the blEWPT command is directly activated by the user.) 



U: PRAWTRIAWGLE; 

(After activating this new command, the user positions 
the stylus three times at arbitrary locations on the surface; 
points appear at these locations, and automatically become 
the vertices of a triangle.) 

Step 3 — The construction of dynamic triangles using picture- 
driven animation, followed by augmentation of the 
basic algorithm of picture-driven animation : 

The animator experiments with moving triangles, using 

the APPL facilities for picture-driven animation. Suppose 

that, as in GENESYS, the system currently allows continuous 

translation of eels, but not continuous scaling. In contrast 

to GENESYS, however, the problem can here be solved smoothly 

within the system. We recall that the basic algorithm 
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implementing picture-driven animation is one which transforms 
eels, and selects among them, according to successive values 
of a set of data sequences called global dynamic descriptions. 
In APPL, this algorithm is expressed as a simple APPL program, 
and hence is easily modified on-line. (Recall Features 5 and 
6, in the previous section.) Modifications might be made, 
for example, so that eels can be transformed continuously 
through scaling and rotation, being driven by path descrip- 
tions, and discretely through reflection about the horizontal 
axis, being driven by a selection description vhich deter- 
mines whether the triangle is pointed 'up' or 'down'. 

Step 1+-- The algorithmic definition of a particular movement : 

Tools for the free-hand sketching of dynamic descrip- 
tions are implemented in APPL through language extension. 
The animator now wants to see the effect of a regular varia- 
tion, such as a sawtooth function, when it is applied to the 
scale factor of a triangle. Thus he writes in APPL a routine 
which computes this path description. 

Step ^-- Additions and modifications to the subsystem for 

defining and refining global dynamic descriptions : 

In APPL, unlike GENESYS, the user has full control over 
the interpretation of the motion of the stylus, since he can 
write programs which monitor its behavior. (Recall Feature 
7 in the previous section.) A library of routines for con- 
structing and editing pictorial representations of dynamic 
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descriptions may therefore be written in APPL. The animator 
can then take an existing program which accepts p-curves and 
modify it, for example, so that the resulting path description 
is defined as the variation of the radial coordinate rather 
than that of the horizontal coordinate. (*8) He can also 
tailor to his own specifications such conventions as the 
signals he gives the system when he wants to start and ter- 
minate the real time sketch. 

Step 6-- The construction of a subsystem for the generation of 
complex static patterns of triangles : 

As the animator works, he calls again and again, with 
varying parameters, the same triangle-generating and triangle- 
modifying commands. Often he activates a function with only 
one of its arguments varied from the previous call, but must 
awkwardly specify its complete argument list again. He also 
designates certain command sequences with regularity, but 
must awkwardly repeat the same actions each time. He there- 
fore writes a small control program in the animation language, 
one that automates many of the time-consuming aspects of re- 
designation of parameters and command sequences, and defines 
the flow of control among commands. Parameters are stored 
in the control program's local data base; commonly executed 
command sequences are made subroutines of the program. Use 
of this language extension speeds the search for interesting 
patterns, which are stored in the system-wide (global) data 
base when the control program's execution is terminated. (*9) 
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Step 7-- Extension of APPL to facilitate operations over 
triangular patterns : 

Operations over complex patterns are facilitated by a 
language with which one can name, describe, and characterize 
subpatt erns . The animator establishes a standard data struc- 
ture with which to model triangles and defines a set of 
attributes which characterize them. {Recall Features 9 and 
10 in the previous section.) These definitions allow him to 
communicate with APPL about a pattern in terms of such con- 
cepts as its center, its area, the number of triangular sub- 
patterns, and its state of geometrical inclusion or exclusion 
with respect to other patterns. The animator may then refer 
implicitly to a set of triangles as "all those enclosed by 
triangle A," and need not always resort to naming explicitly 
or pointing to each one. {Recall the fourth limitation of 
SKETCHPAD listed in II. A. 1.) This is particularly useful if 
the set of triangles varies in a complex manner throughout a 
film. As APPL becomes richer through the addition of new 
picture structures and attributes, it becomes possible 
flexibly to construct, retrieve, and manipulate complex 
pattern configurations. 

Step 8— Construction and activation of APPL programs that 
generate complex dynamic patterns of triangles : 

Some of the desired dynamic effects are achieved with 

eels, dynamic descriptions, and the picture-driven animation 

algorithm. Others, where the eventual evolution of an animation 
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subsequence depends in some complicated manner upon earlier 
aspects of the sequence, are defined directly by new APPL 
programs. This is done by using the APPL constructs that 
control the advance of movie time. Given a number of such 
programs which compute parallel actions in a movie, any or 
all of them can be activated for quasi-parallel execution, 
which is synchronized automatically by APPL. (Recall Feature 
8 in the previous section.) Thus the animator controls which 
aspects of the movie are computed and/or displayed concur- 
rently. Computation or playback may be interrupted at any 
time to allow redefinition of both pictures and programs. 
The ability to decompose the construction of a sequence, to 
synthesize it piece-by-piece, in modular fashion, facilitates 
effective real-time interaction by reducing the short term 
computation and display demands on the system. 
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II. A. 5. IMPLICATIONS OF THE SCENARIO 

The example illustrates the diversity of possible uses 
of APPL, including: 

(l) The mediation of direct user requests to construct or 
modify pictures, such as the first triangle in Step 1; the 
algorithmic definition of dynamic displays, as is done 
directly In Step 8, and is done in part by: 

(a) The algorithmic definition of static pictures, 
such as the second triangle in Step 1; 

(b) The algorithmic definition of picture dynamics 
expressed by movement and rhythm descriptions, such as 
the sawtooth function in Step h ; and, 

(c) After significant extensions to enrich the descrip- 
tive power of the language, the manipulation of a parti- 
cular class of structured pictures, such as the 
triangular patterns in Step 7. A version of APPL that 
has been augmented in this way is one of the coherent 
family of animation languages that was mentioned at the 
end of II. A. 3. In the example at hand, APPL is made 
Into a language well-suited for the animation of triangles 
and triangular patterns. 

(2) The building of a set of tools for interactive computer- 
mediated animation, such as: 

(a) A set of-programs that aid the construction of 
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tic pictures, such as the triangles of Step 2; 



st at i c p 



and , 



(b) A set of programs that interpret complex stylus 
motions as definitions of movement and rhythm, such as 
the one in Step 5. The programs constitute a subsystem 
for defining and refining global dynamic descriptions, 
which may be written in APPL. 
(3) The construction of special-purpose animation subsystems, 
such as the picture-driven- animation subsystem in Step 3; the 
building of special-purpose subsystems, such as the one in 
Step 6, which aid particular picture definition tasks by 
facilitating the execution of repetitive actions and the 
calling of existing routines with suitable parameters. 

We have also seen, in Step 8, that APPL allows the acti- 
vation, for concurrent (quasi-parallel) execution, of sets of 
programs that compute new animation subsequences and display 
(play back) existent ones. 
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II. A. 6. WHAT IS TO COME, AND WHAT IS WOT TO GOME, 
AND WHY 



This chapter has motivated and established guidelines 
for the design of APPL, an open-ended, multi-purpose, inter- 
active animation programming system. The next four chapters 
present an informal outline of the proposed system and the 
programming language embodied in it. Our major purpose is 
to suggest some linguistic constructs with which one can 
directly manipulate structured pictures at an interactive 
console, and with which one can express algorithms that dynami- 
cally transform these images. We have attempted to develop 
constructs that appear most natural and powerful in aiding 
interactive computer-mediated animation, and in realizing 
the guidelines established in II. A. 3. 

In order to write down a description of APPL, we have 
had to adopt a precise form in which statements could be 
expressed, and a particular set of commands to constitute a 
base language. These are not to be regarded as fixed, for 
further modifications of such design details will accompany 
an implementation and empirical evaluation of APPL, activities 
which are beyond the scope of the dissertation. The disserta- 
tion also does not include an ext ended-BNF , canonic system, 
or similar formal presentation of the syntax and semantics 
of the language, since this would be premature and of little 
enduring value. 
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Aspects of the design are closely related to several 
areas of current research in programming languages — techniques 
for language extension, simulation languages, and complex 
data structures. There are many difficult problems in these 
areas that have not yet been solved and that are not solved 
in this dissertation. We supplement pointers to the relevant 
literature with an attempt to demonstrate, through intuitive 
arguments and simple programming examples, the relevance of 
these issues to computer animation and to the design of APPL. 
We indicate where important areas of detail have been left 
incomplete, for example, whether or not there should be run- 
time block structure, which activity scheduling mechanisms 
are most useful for animation, and how the chosen data 
structure can be efficiently implemented. The next researcher 
will have to tackle these questions; we seek only to justify 
that these are the ones he should ask. 
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FOOTNOTES -- II. A. 



BEFLIX has been used primarily in the production of 
computer-animated technical and expository films, 
such as References 6, 15, and 20. 



( 2 > In the case of CAFE, and most likely also in the case 
of BEFLIX, economic constraints ruled out a system 
having direct graphical interaction. Nolan and 
Yarbrough explained their goals as follows: 

There are a number of limitations to this 
experimental system, perhaps the' greatest of 
which is the lack of graphical interaction with 
the construction process. This limitation is 
imposed by a design requirement that the expen- 
sive direct-view CRT not be a part of the 
minimum hardware needed to run the system. 2 

(*3) APPL is more general than JOSS, 65 however, in that the 
latter does not allow defined commands to be used in 
higher-level commands. A new conversational language, 
with excellent, carefully documented design goals 
akin to those of APPL, is described in Reference 66. 
Weizenbaum ' and Licklider68 have su?plied articulate 
introductions to the potentialities inherent in the 
use of conversational languages. 

(*h) This goal is essentially that expressed by Roberts in 
Reference 69. 

(*5) Thus we transform what Licklider 66 calls a "procedure- 
oriented language" into a number of different but 
related "problem-oriented languages." This is how 
APPL^meets the need noted by Knowlton and Huggins 70 
for "either an overall complete language for computer 
animation or a consistent set of intercommunicating 
modules, with well-defined and rigorously described 
interfaces between them." With Cheatham, et al, T1 we 
feel that all aspects of such a language cannot be 
planned in advance, that the so-called "shell approach" 
is a priori doomed to failure. As in ELF 71 we adopt 
the^'core approach," allowing the definition of a 
family of languages through appropriate extensions of 
the core, or base language, of APPL. The first uart 
of Reference 71, and Reference 72, are readable dis- 
cussions of the philosophy of language extension. 



-212- 



(*6) The use of an example involving regular abstract figures 
does not imply that APPL is a priori "better suited for 
this application than for one involving free-hand 
sketching. The examples throughout Part II underscore 
this point . 

(*T) It Is immaterial whether the command is specified by- 
typing its name or an abbreviation for it, by writing 
the abbreviation to a character recognizer, 5 or by 
selecting one of a menu of light buttons located some- 
where on the scope. We recall the problem of the 
geometrical layout of these stylus targets on the dis- 
play surface, discussed in I. A. 3. and particular in 
Footnote 5--I.A. The problem is more severe In APPL 
than in GENESYS, because the open-ended character of 
the system requires that the light buttons be augmented 
whenever a new command is defined. Paging may be the 
only viable solution. 

C*8) We have seen one application of such a program In the 
syntheses of the pulsating heart, I.D., Approach h, 
Technique 2. 

(*9) Here the terms 'local' and 'global' refer to the scope 
of a program variable, or the range of program state- 
ments where the variable's name is bound to a particu- 
lar value, as is explained in II. B. 3, rather than to 
the relative number of frames of a dynamic sequence 
that are affected by a pictorial operation, as in 
'global dynamic description. ' 



-213- 






II. 9. 



i&:I **."#'&*«' # ,1c f ao. .:.$.&..% Jos- I&ft' 



•-# } 




V! . *x & rf is 5* *5 ■"? r : 



^ H f * 3 j£- ^ $ si 'S 1 i- j> 't» %. fflj© * Jl *■£ « * i: J 



v- :? ^SKi^iSp Sl.f.fS >:?K3- £fe£^» yVa?i e- w 
t .h - j .■;.< .. g • J £ S S # E #i|: 3*1 * *© - 3 £■ ;S tf .'? -t ,'< ^ 'J 

-mas ^ t *laJsi--j*^ -^ii-f '-etsrfv s #.',.&« 

* , f 5 u X 3 « 1 1 -n 3- '« £ :?> t £ A a t fc I * 3 C X £ " * 



'""""P 



**£**- 



II.B.l. COMMANDS AND PICTORIAL DATA IN APPL 

APPL, like SKETCHPAD, G-ENESYS, and other interactive 
computer graphics systems, permits the user to add and delete 
points, lines, and other picture items to and from a pic- 
torial data base. What is visible on the scope is changed 
"by commanding the computer to alter the representation of the 
picture in the data base. A data base is constructed in a 
working session with APPL, and may be saved and restored 
from one session to the next. 

More specifically, a pictorial data base consists of 
a structured collection of data items (DATA) and a collection 
of relations (ATTRIBUTES) which establish some data as 
PROPERTIES of others. The data base contains what is con- 
ventionally called the inner or fundamental or structural 
representation of a picture, consisting of all the informa- 
tion about the picture that is stored in the computer. There 
is usually another distinct pictorial data base in a computer 
graphics system, one we shall not consider here, containing 
the outer or visual representation of a picture. This con- 
sists of only that information that is required by the hard- 
ware for the immediate display of the picture. 

Data in APPL are of two kinds, pictures and numbers. 
Pictures may be either pictorial primitives or pictorial 
aggregates; numbers are represented by scalars and scalar 
aggregat es . 
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A PICTORIAL PRIMITIVE is a fundamental picture building 
block, such as a POINT, which is included in the APPL base 
language in the sense that there are commands for its creation 
and deletion and for the assignment and modification of its 
properties. A PICTORIAL AGGREGATE is a structured collection 
of pictorial primitives. To simplify the following presenta- 
tion, the only picture "type" represented by a pictorial 
primitive in the APPL base language will be the POINT; all 
other picture types, such as a LINE, will be represented by 
pictorial aggregates as defined through extensions of APPL. 

A SCALAR is a single number. We shall for simplicity 
consider all scalars as real numbers, since the customary 
computer distinction among integer, fixed-point, and floating- 
point numbers is well understood and its inclusion would add 
nothing to this discussion. A SCALAR AGGREGATE is a struc- 
tured collection of scalars. (*l) 

APPL, therefore, is a medium through which the animator 
creates and manipulates data items — pictures and numbers. 
The ability to manipulate a datum requires the ability to 
reference or retrieve it, and this raises the issue of naming 
data items. Names are created by associating text-strings 
(sequences of characters) with existent or newly created 
data. For instance, APPL contains commands which generate 
new pictures and aggregates. NEWPQ1NT (abbreviated WEWPT), 
UtWPJCTURE (WEWPIX), and hlEWAGGREGATt (WEWAGG) each may take 
a text-string as an argument. (*2) If the identifier 
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(text-string) is already bound to an existing structure, 
that is, names that structure, then the binding is detached 
vithout destroying that structure; in any case, a fresh 
point, null picture, or null aggregate with the identifier 
as its name is created. A picture or an aggregate may have 
several explicit names, as well as heing implicitly identi- 
fiable "by virtue of its position in some aggregate. A datum 
ceases to exist if all its explicit and implicit references 
are destroyed. (*3) 

To increase the legibility of commands and programs, 
and to remove the need for separate type declaration of names, 
we adopt the following rules: The name of a scalar consists 
of a string of small letters, possibly including numbers, 
such as 'x', 'yloc', ' rr ' , ' al ' , and 'gO'. The name of a 
scalar aggregate consists of a sequence of capital letters, 
possibly including numbers, such as 'XX', ' YPATH " , 'SELEC- 
TIONS', and 'RHYTHMO'. The name of a picture consists of 
two sequences of characters separated by a period ('.'), 
such as 'PIX.O', 'P.PCURVE', ' P . XWAVEFORMS ' , 'PT.O', and 
'PT, CENTER 1 . As will be explained more fully in II. E., the 
prefix of a picture name, that Is the character string be- 
fore the period, often denotes the "type" of the picture. 
Specifically, the prefix for a point is 'PT' and for an 
arbitrary picture is 'P' N "PlC, or 'PIX'. 

Typical commands names are " WAIT;", "WEWPT ... at ...;", 
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"SET ... to ...;", "PUT ... Into ...;", "SHIFT ... by ...;", 
and " FORMTRI ANGLE among ... and ... aiaci ...;". Command names 
are assumed to "be uniquely identifiable from the first 
capitalized word. The words in small letters are optional 
dummy separators. They may be spread throughout a statement 
between its parameters, for the purpose of aiding its compre- 
hensibility. Each omitted parameter is indicated above by 
"...". Since command names are considered "reserved words" 
by the system, they are distinguished in their written form 
by the use of italics. 

A COMMAND is the designation of a command name followed 
by its required number of parameters, which can be zero or 
arbitrarily many, A variety of techniques can be used to 
specify parameters in an interactive environment. For in- 
stance, parameters that are visible pictures may be desig- 
nated by pointing at them with the stylus; if invisible, their 
names may be typed into the system. Examples of typical com- 
mands are "WAIT;", "HEWPT PT.A at 0.0,0.2;", "SET x to 0,5;", 
"?UT P,A Into P,B;", "SHIFT P.C by 0.5,0.5;", and 
"FORMTRZANGLE among PT.A and PT,B and PT.C;". 
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II. B. 2. EXTENDING THE COMMAND STRUCTURE 

Pictures are constructed by directing the system to 
execute some of its library of commands. The example in 
Step 1, II. A. U., illustrates the production of a triangle by 
the direct designation of a sequence of six commands. Since 
the construction of a triangle is to occur again and again, 
APPL should have single commands to facilitate this operation. 
If these do not currently exist, the user can increase the 
system power by defining them. 

Three such extensions of the command structure are 
listed in II. A. k. The user designates an ordered, numbered, 
sequence of commands and requests that they be saved as a 
unit for execution at a later time. These units are called 
PROGRAMS, and more specifically PROCEDURES. Commands which 
may be designated for deferred execution include those which 
may be immediately executed. Hence the system must be in- 
structed when to leave execution mode and when to enter 
definition mode, and when later to begin direct execution 
again. This is done by giving the system met a-command 
PEFIWE, followed by the program name and its definition, 
followed eventually by the system met a- command EUV . ( #1 

Much of a practical animation system may through such 
definitional extension be written in the base language. 
Commands thus defined are readily available for modifications 
to suit the demands of individual users. We reiterate the 
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claim, which the sample programs should substantiate, that 
the base language is low-level enough that one may flexibly 
control his style of interaction with the system, yet it 
can smoothly grow to be high-level enough that one may easily 
write and draw interesting animated displays. In the examples 
of II. A. U. t the basic triangle construction algorithm ex- 
pressed by Program 1 is adapted in Program 2 to allow triangles 
to be built on arbitrary existent points as vertices, and in 
Program 3 to allow new points to be generated and positioned 
as well. 

The three commands that constitute Program 2, FORUTKl ANGLE , 
are not expressed in terms of three specific real points in 
the pictorial data base. Instead they are expressed in terms 
of dummy parameters, names that are bound to real pictures, 
and only then have meaning or value, when the program is 
called, or activated. Hence the constituent commands will 
operate upon whichever three points are designated as the 
program's real parameters. If " F0RMTRZ ANGLE among PT.U 
and PT.V and PT.W;" is activated, then within the body of 
the program, that is while the constituent commands are being 
executed, PT . 1 stands for PT.U, PT.2 for PT.V, and PT . 3 for 
PT.W. 

All program statements are given unique identifying 
numbers, or labels. These are expressed as fractions between 
and 1, ordered according to increasing numerical value. 
The labels, sans decimal point, may equivalently be viewed 
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as digit sequences, ordered lexicographically from left to 
right. Hence, the following sequence is in correct order: 
.03, .12, .121, .122, .13, .130, .131, .21, .U5, .99, .999, 

.9999. 

Since the system is open-ended, the command FORMTRI AWG I E 
can he designated- for immediate execution, and can also he 
used in defining higher-level commands. One example of this 
is Program 3, VRAMTR1 ANGLE . That commands can he nested to 
arbitrary depth in programs defining new commands implies 
that in APPL the command language and the programming language 
are harmoniously integrated. It also implies that we must 
consider the issue of the "scope" of the names of data items, 
which is therefore our next topic. 
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II. B. 3. THE SCOPE ISSUE 

The sco p_e of a program name is the set of program state- 
ments in which it has the same meaning, that is, points to 
the same scalar, picture, or scalar aggregate. A name may 
in general have several scopes within a set of subprograms. 
A name whose scope is the "entire set" of subprograms is 
called a global variable , and one with several scopes is 
called a local variable , for its meaning is local to a parti- 
cular subset of subprograms. (*5) 

At least four possibilities exist for dealing with the 
problem of scope in a programming language. (l) All vari- 
ables may be made global. (2) There may be global variables 
and variables local to only the particular subprogram in 
which they are defined. (3) The scope of local variables may 
be extended according to the compile-time block structure of 
the master program. (h) The scope of local variables may be 
extended according to the run-time, or dynamic block struc- 
ture, that is, the meaning of local variables of any program 
calling another is passed on to the called program. 

The first possible solution fails because of the frame- 
word of program calls that is developed in the next chapter, 
since several copies of a particular program may be active 
concurrently at execution-time. The third possible solution 
fails because it appears cumbersome to impose a concept 
of compile-time block structure on a conversational lan- 
guage. It is at this stage of the research not obvious 
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whether the sizeable implementation difficulties of dynamic 
run-time block structure are warranted for the purposes of 
computer animation. Thus the choice between solutions (2) 
and (U) remains an open question. (»6) In either case, 
there must exist both global and jocal pictorial data bases , 
individual programs or sets of programs will contain private 
(local) pictures and aggregates whose existence need only 
be temporary. Yet when the process of animation is termi- 
nated, the global pictorial data base will have been 
augmented, that is movies will have been made. 

Pictures and scalar aggregates are global and exist 
forever, even from session to session if they possess at 
least one global reference. Local names may appear in a 
directly executable command given by the user, including 
their possible use as a direct program parameters, or within 
programs. In the former case, since the user functions as 
the main program, the name has the same meaning in all direct 
commands. An element with only such a name, however, would 
disappear at the end of a session. A local name within a 
program would be reclaimed when the program was terminated. 
If the named datum were located somewhere in the structure 
of an aggregate with a global name, the binding of the local 
name would disappear but the entire structure would remain. 

So that the user can implicitly declare which names are 
global and which are local, a distinction in their naming 
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FOOTNOTES -- II. B. 



(*l) The AGGREGATE mechanism, used for structuring both 
collections of pictures and collections of numbers, 
is the topic of 1 1 , D . 

(*2) Other commands which assign names to data items will 
be described in II. D. 2. 

(*3) This leads to the implementation problem known as 

"garbage collection." The system must be responsible 
for deleting from the data base those items whose 
explicit and implicit names have all disappeared, for 
they can no longer be referenced and hence manipulated 
by the user. 

(*h) Also compatible with this framework is what I call 

"procedure writing after the fact," that is, recalling 
recent sequences of immediately executed commands and 
designating them post-facto as procedures. Such a 
capability would require a mechanism that monitors 
direct commands, Including interactive Input from the 
stylus and other devices, and then transforms its 
representation of these events into a sequence of 
written AP'PL commands. It would further require a 
mechanism whereby the user could replace the names of 
certain objects transformed by these commands with 
dummy procedure parameters. For the results of a 
current investigation into the problem of monitoring 
interactive input and converting it to a written form 
for subsequent reuse including possible modification, 
see Reference 73. 

(*5) We stress again what was noted in Footnote 9 — II. A. , 

that this use of the terms 'global' and 'local' differs 
from their use in expressions such as 'global dynamic 
des cript ion . ' 

(*6) Adoption of run-time block structure leads to diffi- 
culties when programs call themselves recursively, 
unless explicit stack mechanisms are included in the 
language. Another approach, which avoids this problem, 
is that which In many simulation languages allows the 
explicit linking of one program to the local data base 
of another program. We refer further to work on simu- 
lation languages in II. C. 



-225- 



e: : mmso''H 










: b ' 



sia-^-: 2 «-:■■:■!■ *.s^<f' stfai? 'ddx mv%*. ,gai#-9£ a t- "^'i 
: -:■::■:' ' >■-.•? I;jv.n5-n^t *M" ?2HS'o^ 8c it *; c ^«;i-3' 

. *, ., -:^::j "' , ;:-:c>1; ^a / 'j^-fla-' gsMM-iw - »TE#&^ o.-r.] * 

-■"- ..; ■ .' \:?*i: :. '•: 1 * * &■ 1 & *iiSi^ I "5.$ i$S£MPfS fas OS 'I' 

■.'3- jad.* othJ-^s^-s &. s'%J;'#^«>^ Mi?**sr ' '^iJ:itfiiq£^ 

' ■:■] '■ .' * V J .?-. j? '; V ? ",-? j: $a i' fe^ XS.-K £ t $$&&&%&'&■ ^^^1 £& 
,V: ; '-^ ■?;,.;£■* :'■ ;:■>.;;.:• ?-C^ ,g:5 0lVsi 15a:IC IfiiS 4£iY^S 

-iiM--*- 5 .■: ^« t ;■■:. 'si3»va. 3tf : 4if#- to ii0.i ^#^* i is-e'ai'<?f ^ 

■;::=' -a~?.. ■ :^rfj va ■ fcsfe^s^ls-iSirt* E^^e^Cp i? 1 ^ ;* i ~* o" 
:* ■-•.■■-■■-: ->;:: -ra-f , £T^-*-ii&&?t#Ms §:*jfcf£,sE.dn:q v;^-"* 
:ii: "':;■„ ■n-;-i;:-'f:; -s^^ : ;:-,tsi .&£;?: i?4§£ ^g^v^I £jj:s»'1"t JJ :? 
•-TW ,. -^ , , j;;;.J"f*vs^ J^# i^q^■/^^2&^^"■r•s> 
-: -.*•;> :T .7 ^ C -; Ai ib -.i" ^iT 3<SV £«*£« '. 3 JTJfe** V E^*£ < & ^V? 

■■ :*■ ;:^]^-.e , r ;?:nv j ^i^c?t|* *i^il$'^ai^ +&$%£l%a&-> 
a *r* s ^. ( ;Hr-.e.'. rr©.j.+>£i*isi-c : '-^i|;|iit.-isit ids f*hf : *#tf^ ■ ■« i- 

.0-1:1' it I 8*gJSi"ja« 'I iiOi^-L 



(J*) 



(?*') 



^^6^ 



II.C.l. THE INDIVIDUAL CONSTRUCTION OF EACH FRAME 
IN THE SEQUENCE 

The most straightforward way to apply the methods of 
static picture construction to the definition of dynamic 
pictures is through the first approach of I.B., the indivi- 
dual construction of a sequence of frames. The animator 
invokes a sequence of direct console commands such as: 



NEU/PIX P.l; 
ACCEVTSKETCH P.l; 
NEWPIX P. 2; 
ACCEVTSKETCH P . 2 ; 



where ACCEVTSKETCH is implemented in the animation language: 

VEE1NE ACCEPTSKETCH P.O; PROGRAM fg 

.11 5ETC0WTEXT P.O; 

.21 STOVJE STVLUSUV; 

.22 IF STVLUSOT-r- tkzn RETURN; 

.23 NEWPT PT.O at STYLUS-, 

.31 GOTO #.21; 

EUV 

"NEWPIX P.l;" creates a fresh empty picture with name P.l. 
"ACCEPTSKETCH P.l" activates the routine with P.l passed as 
a parameter. This call on ACCEPTSKETCH allows the animator 
to sketch a picture of dots (points) free-hand. He can cause 
the program to terminate when the sketch is completed. The 
next NEWPIX command may then be given. 

Statement .11 (from now on, we shall use the abbrevia- 
tion #.11) is executed as "SETCONTEXT P.l.". Its effect is 
to guarantee that any points or new pictures to be created 
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are included in Picture P.l. (This statement will "be refined 
in the next chapter.) The function of the loop of #.21-. 31 
is to track the positioning of the stylus and record it by 
a sequence of points deposited at stylus locations. We assume 
the use of a Sylvania tablet with three vertical levels, 
STVLUSVOifJN on the surface, STYLUSUP in the air, and 
STV LUSOFF , raised high above the surface; alternatively, 
three states may be simulated by any tablet stylus and a 
pair of switches. Execution is suspended at #.21, if the 
stylus is lifted to the UP state. If it is next returned to 
the surface, looping continues; if it is next lifted to the 
OFF state, execution of the program terminates (#.22). The 
program would be more realistic if rather than terminating 
directly at #.22, it first passed P.l to another program 
which would thin and smooth the sequence of points. 

A somewhat more sophisticated approach automates the 
advance from the construction of one frame to the next: 

VEFIUE ACCEPTSKETCHES P.SEQO; PROGRAM ~#T 

.11 NEWPIX P.SEQO; 

.21 MEWPIX P.O; 

.22 PUT P.O Into P.SEQO; 

.23 ACCEPTSKETCH P.O; 

.21+ GOTO #.21; 

EMV 

Activation of this program with parameter P.SEQ results in 
the formation of a picture P.SEQ (#.ll). It is in turn filled 
with a sequence of pictures (#.22), those successively gener- 
ated and bound to the name 'P.O' (#.2l). Each of these pictures, 
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which may he interpreted as a frame, is individually sketched 
as above (#.23). The program is simplified and defective in 
that no way of exiting from the loop is provided. If this 
were added, then although an individual frame would no longer 
be hound to a unique name, it would continue to exist "by 
virtue of its inclusion in the pictorial aggregate P.SEQ. 

The reader will recall the claim, made in II. A. h. and 
II. A. 5., that APPL can he used for system-building as well 
as for directly generating dynamic displays. ACCEPTSKETCHES , 
a simple program written in APPL, when supplemented with a 
program that plays back P.SEQ, constitutes an elementary, 
special-purpose, interactive animation system. 
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II C 2 THE GENERATION OF FRAMES FROM AN ALGORITHMIC 
DESCRIPTION OF THE SEQUENCE--THE CONCEPT 
OF MOVIE TIME 

The following program illustrates the algorithmic speci- 
fication of a changing display, in which a triangle grows 
through the upward movement of its top vertex (*l): 

DEFINE GROWINGTRIANGLE; PROGRAM # Z 

.11 MEWPT PT.l at 0.0,-0.9; 

.12 WEWPT PT.2 at -0.1,-1.0; 

.13 NEWPT FT. 3 at +0.1,-1.0; 

.21 FORMTRIAWGLE among PT.l and PT.2 and PT.3; 

. 31 MOVE PT.l by 0. 0,0.1; 

.U GOTO #.3l; 

EMV 

In addition to its lack of a mechanism for termination, this 
program is a fundamentally deficient definition of an anima- 
tion sequence. It contains no mention of time , or of the 
speed of the picture change. The speed at which the triangle 
grows apparently depends upon the time it takes the processor 
to execute #.31-.M, a very restricted and machine-dependent 
interpretation. Intuitively, what we want to do is control 
the speed of the computation so that each pass around the 
loop takes, for example, l/2Uh of a second. Although many 
complex calculations cannot he so quickly and reliably com- 
pleted, the ramifications of this suggestion should he 

explored . 

We define a scale of simulated , or movie time , and con- 
trol the dynamics of an animated display hy organizing picture 
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change with respect to this scale. In Program 6, we consider 
it a static program, and call it a PROCEDURE. It is static 
in the sense that the dynamically varying state of the display 
can only be regarded as a means to achieve a final static 
picture, that which results when the program terminates, 
"because the user has no control over the intermediate states. 
Suppose that we add to Program 6 the statement 

.32 PAUSE ioK 1; 

The processor executing the augmented program suspends the 
calculation at #.32, and pauses for 1 unit of movie time to 
elapse. It then computes until the PAUSE statement is next 
encountered, and waits again. Now there are well-defined 
intermediate states of the display, specifically, the pic- 
tures at successive integer values of movie time. We call 
these pictures frames . Hence we say that movie time is 
clocked in frames , that is, one unit of movie time is also 
called a frame. A program containing references to the 
passage of movie time, which are used to organize the dyna- 
mics of picture change, is considered a dynamic program, and 
is called a PROCESS. 

How long is one unit of movie time? He who activates 
Program 6 presumably expects that the sequence of frames 
resulting from the computation will be displayed concurrent 
to their generation at a rate "reasonable" for viewing, and 
that the sequence will be available for later reviewing or 
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"playback. 11 He may designate his own reasonable rate with 
the command SETC LOCKRATE n mite. The rate is usually held 
constant for a calculation, and is often (1000 msec/2U frames) 
= kl msec. This rate is the desired relationship between 
movie time and real computation time. If the program is 
simple enough, the desired correspondence can be achieved, 
and the processor waits during each cycle for a full 1*1 msec 
to elapse. However the actual relationship often deviates 
from this in an unpredictable, computation-dependent manner, 
since movie time cannot advance from unit to unit until the 
new frame is computed or retrieved, displayed, and its image 
appropriately recorded for future playback. 

What happens if the actual speed at which each image 
is updated to form a new frame differs erraticly from the 
desired speed established by SETC LOCKRATEl In the case of 
GROljJlNGTRI ANGLE , the animator can still evaluate the correct- 
ness of his program, which is a major goal in viewing directly 
the results of the computation. Consider, however, the fol- 
lowing program, obtained from ACCEPTSKETCH by the addition 
of one statement: 

VEF1NE ACCEPTPCURVE P.O; PROGRAM #7 

.11 SETCOHTEKT p.O; 

.21 STOFIF STYLUSU?; 

.22 IF STYLUSOTV thzYV RETURN; 

.23 MEWPT PT.O at STYLUS; 

.2k PAUSE ^OK 1; 

.31 GOTO #.2l; 

EMV 
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This is a process that accepts dynamic sketches of parametric 
curves, or p-curves. It is obviously useless if arbitrary 
and unpredictable delays are encountered while generating 
successive points of the curve. Hence, while computing the 
p-curve, the system records the real time intervals between 
successive executions of the PAUSE statement. Suppose that 
these are 60 msec., 90 msec, 50 msec., 75 msec, etc, and 
that the clock rate has been set at U 1 msec. The processor 
introduces artificial delays so that the computation cycle 
time will appear to equal the maximum value of the clock time 
and the cycle times already encountered in calculating the 
sequence. If, as occurs in this example and often in practice, 
there is regularity in what is computed from frame to frame, 
then the cycle time will appear uniform although slow. 100, 
even 200 msec may be satisfactory for ACCEPTFCURVt , provided 
the user is certain that the time will be approximately 
stable from point to point, from frame to frame. These con- 
siderations are fundamental for all dynamic ("real time") 
interactive input. 

We have remarked in passing that successive frames are 
automatically saved for future playback. Of course one can 
compute and then play back sequences of images without using 
a process. Consider the procedure ACCEPTSKETCHZS as an 
example. It directly defines a sequence of pictures. One 
can easily write in APPL a routine which plays back these 
pictures. When a process is used to compute an animation 
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sequence, on the other hand, the system automatically forms 
and stores the sequence of images that exist at each frame 
of movie time. By associating a name with the computation, 
we associate that name with the resulting sequence of frames, 
and can request playback of the movie simply by referring to 
its name (*2) As in BEFLIX, this sequence of frames is also 
what is eventually recorded on photographic film. 

In conclusion, what distinguishes the use of the concept 
of movie time in interactive computer-mediated animation (APPL) 
from its use in off-line animation (BEFLIX) is the attempt 
to control in real time a display of successive frames of 
the movie, both during computation and playback. Given any 
hardware and software configuration, however, this attempt 
will often fail. There will be "compute-bound" movies, 
where processing and retrieval times are too long for effec- 
tive real-time viewing during sequence construction. There 
will be "retrieval-bound" or "display-bound" movies, where 
retrieval and display times are too long for effective 
real-time viewing during playback. If, for a particular 
movie, the real-time display of either computation or play- 
back succeeds, then the interaction will be valuable. If 
both fail, the only remedy is to factor the algorithms or 
pictures into smaller pieces. (*3) Factoring algorithms is 
discussed in the remainder of this chapter, factoring pic- 
tures in the following two chapters. 
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II. C. 3. THE MODULAR DEFINITION OF CONCURRENT 
DYNAMIC ACTIVITIES 



Concurrent dynamic activities are actions which may- 
be conceptualized as occurring "in parallel." Mother knitting 
in the rocker, Father snoozing in the easy chair, and Brother 
under the couch twisting Sister's arm are concurrent dynamic 
activities, for they are distinct picture changes which 
take place over the same extended interval of movie time. 
The independent synthesis of parallel dynamic strands may 
at some stage require coupling and coordination; Brother with- 
holds his affection for Sis's arm until Dad's nodding head 
attains the requisite resonant frequency. Adoption for use 
in APPL of the structure of program control known as QUASI- 
PARALLEL PROCESSING may be supported by analogies to simula- 
tion languages and by an analysis of alternative program 
structures expressing one set of concurrent dynamic activities. 
The argument we now present suggests that an approach to 
language design should facilitate the expression of concurrent 
activities, notes that many of the requisite constructs may 
be adapted from the domain of simulation languages, and 
illustrates how quasi-parallel processing is superior to 
standard sequential processing. 

We have seen how the design of GENESYS facilitates the 
addition of new parallel strands of picture activity. A new 
eel class and its global dynamic descriptions may be defined 
without altering existent eel classes or dynamic descriptions. 
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GENESYS also provides a mechanism that facilitates the 
communication between and the coordination of these strands, 
the rhythm description. 

Simulation is the verbal or mathematical dynamic model- 
ing of a hypothetical or real system; animation is the 
pictorial dynamic modeling of a hypothetical or real system . 
Thus many of the concepts and linguistic constructs developed 
in the five-ten years of research on programming languages 
for model-building (simulation languages) can fruitfully be 
applied to computer animation. (*k) In a statement that 

reflects the current state of the art in simulation languages, 
Jones argues , 

Normal collections of interacting programs find 
the subroutine call mechanism adequate for managing 
the flow of control between the parts of the program 
(e.g., subroutines). Even complicated heuristic 
programs do not require a special calling mechanism, 
although the flow of control is certainly far from 
predictable in these programs. What is different about 
simulation programs? Why is the subroutine calling 
mechanism not adequate for them? 

It is because a simulation model is not just one 
program, but several programs operation in parallel. 
Each activity in a simulation model is conceptually 
executing in parallel with the other activities in 
the mode 1 . . 

Thus, simulation systems need to have a mechanism 
for allowing separate programs to be run sequentially 
but appear to be running in parallel. A mechanism is 
needed for allowing these programs (e.g., activities) 
to transfer control among themselves, in a completely 
unpredictable manner. This is necessary because simu- 
lation programs may contain stochastic elements in 
them which determine when they want to run and for 
how long. Thus, it is impossible in general to pre- 
dict when one program may wish to run, and how long 
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its execution will take. If both of these factors 
were fixed it would he possible to specify a sequence 
of calls from one program to the next program and 
the standard subroutine calling mechanism would 
suffice. T^ (Emphasis added) (*5) 

The mechanism to which he refers may take several forms; we 
shall, adopting the terminology of SIMULA, call it QUASI- 
PARALLEL PROCESSING. 

The necessity for such a mechanism may be supported by 
an analysis of a concrete example from the domain of inter- 
active computer-mediated animation. Consider the process 
RECORPRH/THM, as expressed by the following program: 

PROGRAM #8 



VETINE RECORDRHYTHM o{ buttonnumber 0.6 RHYTHMDES CRIPTION ; 

.11 WEWAGG RHYTHMDESCRIPTION; 

.12 WAIT; 

.21 WAITUWTIL BUTTOW buttonnumber OR TOG buttonnumber; 

.22 IF TOG buttonnumber tktn RETURN; 

.23 PUT MOl/IETIME into RHYTHMDESCRIPTION; 

.2k WAITtiWTIL NOT BUTTON buttonnumber; 

.25 GOTO #.21; 

ENV 



RECORPRH/TffM accepts the rhythmical tapping of a push-button 
and records it as a scalar aggregate representing a rhythm 
description. The WAIT command, defined in the next section 
with greater precision, signals the system that the routine 
is a process, holds execution in abeyance until the user 
signals that he is ready by giving the direct command GO, 
and then turns on the clock of movie time. (*6) In writing 
the program we have assumed that the console has an array of 
push-buttons and that the scalar parameter 'buttonnumber', 
when rounded to the nearest integer value, identifies 
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one of them. Execution is suspended at #.21 until the 
selected button is depressed or the corresponding toggle 
switch is set. In the latter case, execution is terminated 
(#.22). In the former case, the value of the clock in units 
of movie time is recorded in the scalar aggregate 
RHYTHMDESCRIPTION (#.23). The second [UAJTUMT1L command 
guarantees that one must press and release the button before 
a new value is recorded. Movie time advances concurrently, 
independent of the position of the button. 

A natural question arises — what happens if one is 
tapping with several fingers on several buttons, or if 
several animators are thereby recording their rhythmical 
interactions? The transfer of control among programs re- 
cording each button's behavior Is certainly "completely un- 
predictable." Quasi-parallel processing allows the rhythms 
to be multiplexed by activating a number of copies of this 
process to accept input from distinct buttons, that is, by 
calling it with different values assigned to the dummy 
parameter ' but tonnumber ' . Nothing could be simpler! Alter- 
native approaches, without quas i -parallel processing, require: 

(1) The construction of a single routine that processes 
aggregates of buttons with an elaborate scanning mechanism 

to identify which are depressed at a given instant; 

(2) The construction of a cyclic set of routines, 
needing modification with the addition of a new button, each 
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of which would call the next until the last were reached, 
movie time were updated, and control were passed back to the 
first routine; or, 

(3) The construction of a "main program," needing modi- 
fication with the addition of a new button^ which would keep 
track of and control the cyclic execution of a set of indivi- 
dual button-interrogating routines. 

Each alternative, particularly in the more difficult 
situations which occur when the parallel activities are not 
copies of a single process, is decidedly unattractive com- 
pared to quasi-parallel processing. Hence we shall proceed 
to its exposition without further Justification, 
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II.CU. THE FLOW OF CONTROL AMONG INTERACTIVE APPL PROGRAMS 

The first feature of quasi-parallel processing that 
distinguishes it from conventional sequential processing is 
the importance of a strict separation between the definition 
of a program and its use, and the possibility of the concurrent 
existence of several instances of the same program. Each 
instance has its own private local data base. A use of a 
procedure is called an EVENT; a use of a process is called 
an ACTIVITY. ( *T ) 

Consider the following application of the routine 
RECORPRtf VTHM . An animator, programmer, and educator are 
collaborating on a film. While viewing the current version 
of one constituent sequence, the picture called P. SCENE, 
each wishes to record, without interrupting the playback, 
the frame values of key points that interest him. To achieve 
this, three copies of RECCRVR.HVTHM are to be run in quasi- 
parallel execution with a playback routine, one which is 
implemented in the language as follows: 



VEEIhlE VIEWSCENE P. SEQUENCE; PROGRAM #9 

.11 SHOW 'THIS MOVIE IS' P. SEQUENCE at xt it le , y t i t le ; 

.12 WAIT; 

.21 FOREACH p.o in P. SEQUENCE VO PART 21; 

.211 5H0W P.O; 

.212 PAUSE ion. 1; 

.213 HIVE P.O; 

EHV 

#.11 will produce a display of the title, "THIS MOVIE IS 
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P. SCENE," at the coordinate values bound to the scalar names 
'xtitle' and 'ytitle'. The EOREACH statement will step 
through the pictorial aggregate P. SCENE, executing Part 21, 
that is, #.211-. 213, upon each picture in the aggregate. 
(Part abc , where a, To, and c are digits, consists of all 
statements with labels of four or more digits such that the 
first three digits are a, b, and c. Part 21 may therefore 
include #.210, #.210000, #.211, and #.2199999999.) The SHOW 
command makes the designated picture visible, the HIVE command 
makes it invisible. 

The following five commands must now be given directly 
to the sy s t em : 

VIEWSCEHE P. SCENE; 

RECORVRHVTHH oh 1 gl& RD1 

RECORVRHVTHM c£ 2 cu> PD2 

REC0RVRHVTHM otf 3 a* RD3 

GO; 

The first four commands activate processes; the fifth one 
triggers their quasi-parallel execution. The system knows, 
from the program's definition, that VTEWSCEUE is a process. 
However, its activation must not cause the playback to begin 
before all the button-monitoring routines are active. A 
mechanism is required to enable the designation of several 
activities before the dynamic phase of their combined 
execution begins. We adopt one such mechanism, patterned 
after the sequencing set of SIMULA and the agenda of OPS, 
which we call the AGENDA. 
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Designation of the first activity triggers the execu- 
tion of all its statements encountered prior to the WAIT 
command. In this case a single statement, #.11 of t/IEWSCENE, 
produces the title on the display scope. The system is then 
ready to accept a new command. Designation of the next three 
activities, all instances of KECQRVRHVTm , has a similar 
result— only the NEWAGG commands are executed. A good in- 
tuitive model is a racetrack where horses can he brought into 
their starting gates only one at a time, although all must 
be entered before the race can begin. This phase of the 
construction of an animation sequence is called the static 
phase , for complete executions of events constructing static 
pictures, as veil as shifts into define-mode producing new 
procedures and processes, may be interspersed among initiali- 
zations of activities. In a static phase the clock of movie 
time is not running, and the user controls the system through 
the direct designation of commands. 

The GO command turns on the clock and triggers the 
dynamic phase . Processes are now executed as simulated time 
dvances. Under certain conditions, execution is halted and 
static phase re-entered. Alterations may then be made to 
static pictures and programs. The dynamic phase may be re- 
sumed by a CONTINUE command; alternatively, a new dynamic 
phase may be initiated by repeating the GO command, which 
turns on the clock after resetting it to zero. 
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The agenda controls execution during a dynamic phase. 
Each process activation has placed the corresponding activity 
at the end of the ordered agenda of current computations. 
Execution after the GO signal proceeds in round-robin fashion 
as primarily determined by program positions on the agenda. 
A scan of the agenda uniquely determines the next potential 
computation, thus avoiding the indeterminacy possible' in so- 
called "parallel" processing. The agenda scan guarantees 
that all computations relevant to the current instant of 
movie time are completed before its clock is advanced. The 
agenda is an intermediary which automates the cyclic book- 
keeping to which we alluded at the end of the previous section. 

In the static phase of the above example, four activities 
are placed, in the order of their designation, on the agenda. 
After receiving the GO signal, the system begins to compute 
the V1EWSCENE activity. It displays the first picture of 
the sequence P. SCENE at #.211, and suspends the routine's 
execution at #.212. It then considers the next entry on the 
agenda. #.21 of RECORVRHVTHH causes it to check the states 
of the first push-button and toggle switch. If the switch 
is ON, the activity terminates and is removed from the agenda. 
If the button is depressed, the value 1 (the clock time) is 
recorded in RD1 . Execution of this activity is eventually 
suspended at #.21 or at §.2h and the system considers the 
next agenda entry. Both it and the third RECORVRHYTHM com- 
mand are similarly processed. The system then compares the 
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execution time since the GO signal was received to the last 
previously designated "clock rate." If that interval of 
time has not yet elapsed, the system continues scanning the 
three button-monitoring programs, looking for an opportunity 
to continue their execution. If no opportunity arises 
before the requisite time elapses, the movie clock is advanced 
by one unit, and the agenda scan begins anew. Execution then 
resumes at #.213 of l/IEWSCENE. 

The user may at any time push a HALT button and begin 
a new static phase. The contents of the agenda are not 
affected by the HALT command. Clearly a VEACTJ VATE command, 
which removes items from the agenda, is also required. The 
command "VEACTJ l/ATE ALL;" clears the agenda. The command 
"PEACTiyATE FIRST RECORVRHYTHM ; " removes the first copy of 
this process. If the command sequence, "HALT-, PEACTIl/ATE 
FIRST RECORVRHYTHM; CONTINUE;", were given the dynamic phase 
would continue with only two push-buttons active. 

An alternative method of termination consists of includ- 
ing PEACTIl/ATE calls in the processes themselves. This has 
already been done in one way. The RETURN command of #.22 of 
REC0RPRH/THM is equivalent to the command "PEACTI l/ATE SELF;". 
If #.22 were changed to 

.22 IF TOG buttonnumber than VEACTJ\JATE ALL; 

then the agenda would be cleared whenever any of the three 

users turned on his toggle switch. Somewhat more useful would be 
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.22 IF TOG buttonnuiter tkzn HALT; 

for it allows immediate resumption, via the CONTINUE command, 
without restructuring the agenda. 

A fuller description of quasi-parallel processing and 
of the role of the agenda requires specifying in detail the 
conditions that can interrupt the execution of activated 
programs, the response of the system to each interruption, 
and the effects that one program may have on the execution 
of another. Although a full analysis is beyond the scope of 
the dissertation, we conclude this chapter with a sketch of 
the relevant issues. 

One source of complexity arises because activation of 
a procedure does not necessarily result in its immediate 
execution to completion. A number of conditions may cause 
the interruption of the event's calculation. The value of 
a program parameter or referenced variable (name) may not be 
suitably defined. (it may itself be undefined, or it may be 
bound to another name which is undefined.) A program called 
within the procedure may not yet be defined. Finally, further 
execution may require user interaction such as the positioning 
of the stylus on the tablet surface or the setting of a 
toggle switch to a particular state or to a new state. 
Depending upon the nature of the interruption, either all 
execution is stopped until new input is provided, or only 
the interrupted event is suspended, placed on the agenda, and 
its state preserved for future resumption. We shall not here 
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decide which action is a more appropriate response to each 
of the variety of interruptions that may occur. The choice 
is not critical with respect to a static phase, for in either 
case the user can he immediately notified of the unbound 
datum name or program name or of the missing input. 

In a dynamic phase, however, stopping the execution of 
only the interrupted program results in significantly differ- 
ent system evolution than does stopping all execution. In 
the former case, one entry is suspended from the agenda, hut 
cycling and the advance of movie time continue. In the 
latter case, some user input is required before any further 
processing can take place. Examples of the former kind are 
"PAUSE faoK 3;", which suspends the process for 3 units of 
movie time, and the WAITUNTIL commands of RECORVRHYTHM . An 
example of the latter kind, parallelling WAITUNTIL, is 
"ST0P1F TOG 1+;", which stops all execution when the fourth 
toggle switch is set. Notice that, since events as well as 
activities may he placed on the agenda, a ST0F1F command may 
also appear in a procedure. 

Thus the system in a dynamic phase computes on all 
active programs until it has completed at least one total 
agenda scan, and until a real time interval greater than the 
"clock rate" has elapsed. It then increments movie time by 
one unit, and scans the agenda anew. If any program is stopped, 
all are stopped until one of the four following conditions 
occurs. (l) The cause of the interruption may be removed 
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directly, by designating a target, for example, if a target 
is awaited; execution then resumes as if the stop had never 
occurred. (2) If some other input is given, a new agenda 
scan searches for a previously suspended activity "which can 
now he resumed. If it finds one, and that also resumes the 
stopped activity, all execution proceeds; otherwise, it stops 
again. (3) If the HALT button is pushed, a static phase is 
re-entered, from which new commands may be activated and 
dynamic execution later continued. (h) If the CcJNTIMliE 
button is pushed, execution of the interrupted program is 
attempted again. (*8) 

An activity or event is therefore always found in one 
of seven states. At the Instant of real time at which it 
Is in execution, it is running . If it is on the agenda 
awaiting execution during the current instant of simulated 
time, it is act ive . Instances of programs must run sequen- 
tially but are active in parallel. If it has been self- 
interrupted by a command such as PAUSE, or by a SUSPEND 
command given by another activity (see below), it is suspended . 
If it awaits necessary Input such as is the result on en- 
countering a ST0P1V command, it is stopped . If a new static 
phase has begun, it is halted . If it has terminated its 
execution, It is deactivated . (Actually, it can never be 
found in this state, for it no longer exists.) And finally, 
as we shall now explain, if it has directly called another 



-21+8- 



program which is currently in one of the first five states, 
it is inact ive . 

The inactive state arises because procedures and pro- 
cesses may themselves activate other procedures and processes. 
This is done in one of two fundamentally different ways. A 
direct call causes an immediate transfer of control; the 
caller is made inactive and its further execution delayed 
until the called program terminates and returns. Alterna- 
tively, an event or an activity may "be s cheduled rather than 
directly called. Execution of the scheduler continues; exe- 
cution of the new program begins later as determined by where 
it is placed on the agenda. Activities may also change the 
state of other activities. Calls to SUSPENP and RESUME an 
activity have obvious meanings in the light of the above clas- 
sification of states. Typical commands, illustrating possible 
mechanisms for referring to events and activities on the 
agenda, would be "SUSFEMV SELF;", "KtSUME FIRST on AGENPA;", 
"SUSFEHV LAST REC0RPRH/THM; " , and "PEACTIl/ATE ALL 
RECORPRH/THM;". (*9) These may be included as statements 
in a program's code or may be given directly by the user 
during a static phase. 

One can view the various items on the agenda, excluding 
inactive items, as separate strands of a total computation. 
Calling a program directly from another has the effect of 
lengthening one strand; scheduling an event or activity adds 
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FOOTNOTES -- II. C. 



(*l) We assume here, for simplicity, that the lines of the 
triangle are somehow constrained to move with the 
vert ices . 

(*2) In implementation environments such as the TX-2 system, 
where there are both inner structural and outer display 
representations of pictures, ACCEPTSKETCtf ES might pro- 
duce the more detailed representation of the animation 
sequence; the automatic feature, only a display file. 

(*3) We do not assume, incidentally, that all aspects of 

interactive animation require the full attention of the 
computer. In a time-shared environment, however, the 
animator must obtain sufficient attention for his 
dynamic interactions to be meaningful. Hence the acti- 
vation of a process, which requires close coordination 
between the passage of real and movie time, is a signal 
to the system that the animator must have absolute 
priority until further notice. The effects of a system 
implementation on aspects of the real-time computation 
and playback of animation sequences is further discussed 
in III.B. 

(*U) Conversely, animation could be applied to depict the 
results of a simulation. 

(*5) Jones, 7 ^ pp. 92-93. 

(*6) WAIT commands, which for simplicity were temporarily 
omitted from Programs 6 and 7, must appear in all 
processes. In Program 6 it could be #.lU or #.22, in 
program 7, #.12. 



(*7) Our definitions of these terms reverse those of SIMULA, 
for we find our choices more intuitive. 

(*8) Programmers will realize that the ST0PIF command may be 
used to implement a very effective generalized-break- 
point, "break if some condition is met." 

(*9) A more complete definition of APPL should include a 
precise specification of these mechanisms. 
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II.D.l. DESIGN CRITERIA FOR A DATA STRUCTURE 

The inclusion of a data structure in a picture process- 
ing language requires in 19&9 no elaborate justification. 
All data is in fact structured— a "programming turn" in the 
lowest of low-level languages facilitates his own retrieval 
of aggregates of data items by mnemonic naming and by lexi- 
cographic coding tricks, for example, letting the variable 
names representing x coordinate values all begin with the 
letter x. A data structure is simply a mechanism whereby a 
pre-established coding schemata transfers to the computer 
some of the burden of appropriately linking related data and 
making it more easily accessible. A data structure is there- 
fore appropriate for a particular class of problems insofar 
as it mirrors the patterns of relationships that exist among 
related data items, and insofar as it facilitates the specifi- 
cation of the most useful accessing paths through the struc- 
ture. The remainder of this section describes the criteria 
that a data structure for interactive computer-mediated 
animation should satisfy. (*l) 

(l) The design goals for the data structure should be 
as independent as possible of implementation considerations. 
This is particularly important at the current stage of the 
research, since in designing the language on paper we seek to 
clarify the requisite concepts and furnish a vehicle for 
communication about computer animation. Eventually, the 
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simplicity of the conceptual language described here should 
he carried through to the operational language, so that the 
user not be forced to furnish details whose only function is 
to facilitate translating or running efficiently. 

(2) All manipulable substructures should appear to the 
user dynamically allocable, and capable of enlargement to 
arbitrary size. 

(3) The data structure should facilitate the processing 
of sequences of data. As we have seen in Part I, sequences 
of static pictures which form dynamic pictures, spatially or 
temporally ordered sequences of points or values, and se- 
quences of selections from sequences, all play an important 
role in interactive computer-mediated animation. 

(h) The data structure should facilitate the processing 
of hierarchies of data. Strong evidence for this requirement 
is found in the recursive picture processing operations of 
SKETCHPAD, such as the "move" command which is defined 
recursively in terms of the moving cf subpictures. Only the 
ability to establish and manipulate complex hierarchic struc- 
tures will enable complex pictures to be expressed in terms 
of a few pictorial primitives. 

(5) It should be possible to include a single substruc- 
ture in various (related or unrelated) superstructures. This 
results in the phenomenon known as sharing, and its function 
is to provide various paths of accessibility to the single sub- 
structure. It is assumed that the system will handle the 
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"garbage collection" problem, and hence data no longer acces- 
sible to the user will eventually disappear automatically. 

(6) The mechanisms for accessing or retrieving data from 
structures should he as flexible and powerful as possible. 
Accessing may he explicit or implicit. Explicit accessing 
consists of providing one of the possibly numerous names for 

a datum. Implicit accessing results from defining a path 
through a named structure or from defining a search for de- 
sired properties among elements of an explicitly named 
structure . 

(7) Finally, the mechanisms for structuring pictorial 
primitives and numbers should be as similar as possible. Not 
only will this facilitate learning the language, but it will 
promote the plasticity in the manipulation of dynamic data 

to which we referred in Part I, the ability flexibly to 
transform the representation of dynamic information among 
numerical sequences, static pictures, and dynamic pictures. 
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II. D. 2. THE AGGREGATE 

A single kind of data structure will be used to model 
both complex pictures and such collections of numerical data 
as global dynamic descriptions. The data structure is called 
the aggregat e . Aggregates possess characteristics of (ordered) 
sets--one may test if a datum is a member of a given aggre- 
gate, and, if it is a member, obtain its ordinal position. 
Aggregates possess characteristics of multi-dimensional 
arrays— one may retrieve an element embedded in a data 
hierarchy by specifying a finite number of ordinal positions. 
Aggregates possess characteristics of rings— one may access 
forward or backwards along a chain of linked data, testing 
for the beginning or end of the chain, and testing whether 
a datum is itself an aggregate, that is, a pointer to a 
lower level ring. The aggregate structure was developed 

independently, then found to parallel Balzer's excellent yet 

7 ft 
mi s 1 eadingly-t it led concept of dataless programming . 

Balzer describes the goal of dataless programming as 

follows : 

It conceives of a program as the specification of 
a set of manipulations to be performed on a set of 
data values, and that this specification should be 
independent of the form in which these data values 
are represented.^ 

7 ft 
By form he means what D'Imperio calls a storage structure, 

the real physical encoding of a logical and conceptual data 

structure. The term 'dataless' is misleading in that the 
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"body of a program is to be storage-structure independent, 
but not data-structure independent. There is a data structure-, 
in APPL called the aggregate, which is a generalization of all 
ordered hierarchic data representations, including the array, 
list, and ring. Balzer correctly notes that a programmer 
who chooses an array early in his coding may at a later stage 
wish it were instead a list or a ring. The solution is the 
definition of a data structure so general that it includes the 
common accessing mechanisms of these ordered hierarchic data 
representations. However, it appears unreasonable to imple- 
ment a correspondingly general storage structure. Balzer's 
solut ion is : 

Once the user has completed this programming, he 
can determine for each collection (aggregate) what data 
representation is suitable for the processing involving 
that collection. '" 

Thus if the programmer discovers that all references to 

elements of a particular aggregate are expressed as ordinal 

positions, he can make the correct implementation choice of 

an array. 

The current definition of the aggregate mechanisms differs 
from dataless programming primarily in that: 

(l) There are no commands with which the APPL user can 
choose a storage structure to implement a particular aggregate, 
since issues of implementation have not yet been considered. 
In view of the first design goal stated in the previous sec- 
tion, we intend' to minimize the information of this kind 
that the user must give the system. 
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(2) APPL has parallel and non-overlapping aggregation 
mechanisms for the domain of numbers and for the domain of 
pictures. I hope that this simplification will help the 
novice programmer comprehend the structuring of data, since 
the need for structured collections of numbers and structured 
collections of pictures should he intuitively reasonable. 
Mechanisms for associating numbers with pictures are discussed 
in II. E. 

(3) In dataless programming, the user must declare the 
hierarchic structure of an aggregate and name and declare 
each sub-aggregate at compile-t ime . In APPL, any aggregate 
may be dynamically grown to whatever complexity is desired. 
(*2) (*3) 

The aggregate is best defined through an enumeration of 
the constructs for its manipulation. These include commands 
for: 

(1) its construction and destruction; 

(2) its aggregation and disaggregation; 

(3) its reaggregat ion ; 

(h) the access or retrieval of a datum from an aggregate; 

(5) iterative data access or retrieval; 

(6) analysis of aggregate structure. 

Finally, the process of the assignment of names to values and 
the question of structure sharing are discussed. 
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( l ) The construction and destruction of aggregates : 

The command "NEWPICTURE PICA;" (abbreviated "NEWPIX 
PICA;") generates a new empty picture named PICA. If a 
picture PICA already exists, it is cleared, that is, all 
its elements are removed. Similarly, "MEW AGGREGATE PATH1;" 
(abbreviated "NEWAGG PATH1 ; " ) creates a new empty scalar 
aggregate. "NEWPIX PIC.B a* (PT.A FT.B (PT.C PT.D));" 
generates a new picture PIC.B, whose first element is PT.A, 
whose second element is PT.B, and whose third element is the 
aggregate whose first element is PT.C, and whose second element 
is PT.D. "DELETE PICA;" or "VELETE PATH1;" totally destroys 
an aggregate and all its unnamed substructures not included 
in any other aggregates. All elements of aggregates are 
actually references , or pointers, to numbers, pictures, and 
other aggregates. Thus the existence of an element is inde- 
pendent of its relationship to the aggregate, unless it has 
no explicit name and is included in no other structure. In 
this case, it should be garbage collected, for it can never 
be referenced again. 

( 2 ) The aggregation and disaggregation of data items : 

The command "INSERT PT.A <U FIRST otf PIC.C;" inserts 
PT.A ahead of all existing elements in the aggregate PIC.C. 
"INSERT PT.A a& THIRP 0$ PIC.C;" leaves the first two ele- 
ments of PIC.C unchanged, but places PT.A ahead of all other 
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elements. n P(JT PT.A Into PTC.C;" is an abbreviation for 
"INSERT PT.A a* LAST oi PIC.C;". (*k) The command "TAKE 
PT.A iKom PIC.B;" results in PIC.B = (PT.B ( PT . C PT.D)), 
whereas "TAKE PT.C tf/LOm PIC.B;" leaves PIC.B unchanged or 
generates an error. (PIC.B was defined above.) 

Since APPL programs will use heavily the capacity to 
hierarchically structure pictures, we adopt a pictorial 
context convention to simplify the specification of such 
commands. Execution of "SETCQNTEXT PICE;" guarantees that 
each newly generated picture, such as a point created by 
NEWPT, automatically be included as the last element of 
the context PICE. "REMOVE PT.A;" is therefore equivalent 
to "TAKE PT.A (J/Lom PICE;". The context is kept in stacks, 
with a unique stack assigned to the set of direct commands 
and one to each quasi-parallel computation strand. 
"SETCOHTEXT PICE;" pushes PICE onto the top of the appro- 
priate stack. RESTQRECQblTEXT pops the stack, WOCOWTEXT clears 
it. (*5) The pictorial context serves as a buffer or 
working area for the assemblage of new pictorial aggre- 
gates. It particularly simplifies the process of aggre- 
gation according to the order of creation of new pictures; 
each is automatically appended to the sequence. 
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( 3 ) The reaggregat ion of data items : 

Ordering aggregate elements "by their instants of 
creation may later prove unsatisfactory. Sorting routines 
can easily be written in the language. Because of its wide 
applicability, however, one automatic sorting capability is 
provided. If the elements of PIC.F are points, then the 
command "ORDER PTC.F by (±)X;" rearranges the points of 
PIC.F according to increasing (±)x coordinate. Any picture 
attribute defined on the elements of the aggregate can be the 
ordering criterion. (Picture attributes are discussed in the 
next chapter . ) 



(k ) The access or retrieval of a datum from an aggregate : 
The mechanism for accessing individual elements of an 
aggregate is called a selector . Examples of selectors are: 
FIRST, SICOUV, TH1RV, 6TH, kTH, LAST, THIS, NEXT, PREVIOUS, 
TH1RV AFTERTHIS, 6TH BEFORETHIS, and kTH FR0MLAST. These 
constructs include the usual accessing mechanisms of arrays 
and rings. The scalar "k", when evaluated in one of these 
selector expressions, is rounded to the nearest integer. 

Each aggregate, whether explicitly named or not, has an 
implicit pointer, which implements the 'CURRENT' mechanism 
of dataless programming. Relative selectors such as THIS 
and MEXT are interpreted with respect to this pointer. Upon 
creation of an aggregate, it points to the first element; it 
may also be explicitly assigned by a statement such as 
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"BEGINAT LAST o /J PIC.G;" or "BFGIWAT PT.A In PIC.G;". Still 
undecided in the language's design is the choice of conventions 
and commands to aid the user's control of the movement of the 
implicit pointer, (When scanning the aggregate PIC.G-, one 
would want the reference "...NEXT a { PIC.G..." to move the 
pointer of PIC.G to the right, but in other circumstances 
such automatic movement would he unfortunate.) Explicit 
pointers, or bugs, may be simulated by the use of scalar 
variables as selectors, although inclusion of the 'GENERATOR' 
concept of data less programming would be more elegant. 

Hierarchic accessing paths are achieved by cascading 
selectors. "...FIRST & kTtf £ PIC.G..." retrieves the first 
element of the kth element of PIC.G. If Implementation is 
not too difficult, varieties of syntactic sugar would be par- 
ticularly helpful here. Preferable to the bulky "SECOND 
TROMLAST o{ \TH AFTERTHIS o i alphaTn 1 o{ PIC.G" would be 
"PIC.G (alpha, k AFTERTHIS, SECONV FROMLAST)". (*6) 

{ 5 ) Iterative data access or retrieval : 

Much of the processing of complex pictures can be 
expressed in terms of operations iterated over elements of 
an aggregate. Typical iterative commands are: 

FOR i=0 STEP l UNTIL i>10 VO NEDJPT PT.O at -1 . 0+ ( . 2 ) * ( i ) , . ; 
FOR i=j STE? k VO PART ll; 

FOREACH PT.O In PIC.H FROM PT.A THROUGH THl RPFROMLAST VO #.211; 
FOREACH xx -In -PATHA UNTIL # (xxePATHA ) = 10 VO -xx^xx; 
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The first statement places a string of 11 equally spaced 
points along the horizontal axis of the current pictorial 
context. The second statement, which has no termination con- 
dition, loops if PART 11 contains no reference to simulated 
time; otherwise, it continues executing as long as the clock 
of movie time is running. The third statement causes the 
execution of #.211 on successive elements of PIC.H, beginning 
with that which is also named PT.A, and ending with the third 
from the last element. The fourth statement negates the 
values of all "but the first ten scalars in PATHA, scanning 
PATHA from the last element towards the first. 

( 6 ) The analysis of aggregate structure : 

The ability to interrogate the system about the aggregate 
aids the accessing of a dynamically changing structure. The 
primitive function "SIZE £ . . , " , when applied to an aggregate, 
yields a scalar whose value is the number of elements of the 
aggregate. The functions "IF PIC. I { I5WI L / ISAT0MI C/ ISUNARV 
/ISMULTIPLE} . . . " test, respectively, If PIC. I is empty, is a 
pictorial primitive, is an aggregate with one element, or is 
an aggregate with many elements. "IF PI C . I ePIC . J . . . " tests 
if PIC. I is an element of PIC. J. If this is true, then 
"#(PIC.IePIC. J) . . . " yields the ordinal position of PIC. I in 
PIC. J. "IF ATSTART PIC.I..." and "IF ATZHV PIC.I..." test 
if PIC.I's implicit pointer is at the first or last element 
of the aggregate. If PIC. J is an aggregate containing one 
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element only, then ". . ,+PIC.J. . ." yields that element. In 
any case, " . . . -t-PIC . J . . . " is a pictorial aggregate whose only 
element is PIC. J. 

( 7 } The assignment of names to values : 

Consider the problem of recording and updating a property 
of a dynamically changing pictorial aggregate. For example, 
the use of a picture called a waveform aids the editing of a 
path description, as we have seen in Chapter I.C. Imagine 
that the user requires in the pictorial data base a record of 
which picture point is the absolute maximum of the waveform 
WAVEA. Available is an attribute MAXIMUMS, a function which 
takes a pictorial aggregate as an argument and returns the 
desired point as the value. "MAXIMUM/ 0& WAVEA..." is to 
yield PT.MAX. But what does "yielding PT.MAX" mean? What 
is ass igned the name PT.MAX? 

One interpretation is that the desired point is to be 
identified, a copy made, and the copy preserved under the 
name 'PT.MAX'. This is not suitable, however, if the waveform 
is later resketched. A second interpretation is that the 
name 'PT.MAX* is bound to the maximum element of WAVEA. This 
is acceptable if resketching changes the value but not the 
ordinal location of the maximum element. It breaks down, 
however, if the new waveform shape shifts the location of 
the maximum. A third interpretation, suitable also for this 
case, is that the name 'PT.MAX' 1 is bound to the picture 
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expression "MAXIMUM/ o{ WAVEA", in the sense that future 
references to PT.MAX result in a r ecomput at ion of "MAXIMUM/ 
0^ WAVEA". (*?) 

All three interpretations should be included in the 
language. Hence "3->x;" results in the creation of a new 
scalar 3 assigned the name 'x». "MAXIMUM/ 0& WAVEA + PT.MAX;" 
identifies the desired element of WAVEA, copies it, and as- 
signs to it the name PT.MAX. "SET x to y;" identifies the 
scalar named by y, and assigns it an additional name x. 
"SET PT.MAX to MAXIMUM/ OfJ WAVEA;" identifies the desired 
element of WAVEA, and assigns it an additional name PT.MAX. 
If WAVEA were then deleted, its element named PT.MAX would 
still remain. "LET x be y + 3;" means that future references 
to x will be evaluated as if "y + 3" had been written. "LET 
PT.MAX be MAXIMUM/ oi WAVEA;" means that future references 
to PT.MAX will be evaluated as if the picture expression had 
been written. 

Can one APPL expression be bound to another expression? 
We take "MAXIMUM/ i WAVEA + FIRST otf P.PTSMAX;" to mean that 
the desired element of WAVEA is copied, and a reference to 
the copy is made the first element of the pictorial aggregate 
P.PTSMAX. We take "SET FIRST otf P.PTSMAX to MAXIMUM/ oi 
WAVEA;" to mean that the reference, or pointer, to the element 
is copied and made the first element of P.PTSMAX. Because 
elements are references, such sharing of structures can be 



-265- 



allo*«4, Stt**tit«tjtn e tfiT for IfT^tfhi^^^^lU^ot >ill«»«t ¥ 
f Mtiitti* fit frodoet i«o ~ q* ; ***• a**J©# £*«|*l****r}*#f*«»» a****** i- 

fied. VT*) '."ASVAW H 

'..,•: ■•. 1g :■. /it •■?'!- ■:■=:-::? f< ;; 3 ; " i iT £ $ <* % X* £ * S>'pfi»K' . :* IS JB l: fc . ; S I 

fc S i:j 9 i »fi.t ay r:;^«i>i r, ;A3v&¥ %.& W&1KAM ft* :XAM,T^ T32 H 
£J:! vj X.AM.1': ,<J-3JJfi« -jntffisls *#£ r .&3# r 9£g!.f «*« £ l|f*f A3VAV 1:I^. ; 

■ ; t&mid i-fv ■ a *s *f ■■■',- .■- 
t -.ify.; s - : \ ,f>:s -:*dJ :.:i; .jJ tii^^-cJ .*q ai>t8#tq£s J 8 ? 4 !! . ?«c ■•;#?■ 

o...r »'..rt«>-i"?i , !:ij'; .; rft& , £H>tqott ai Al:f&$ lo .'Jii»*t«J.s ; fc«*siael: efftf 

fnasisl? ^tt? o * ,-n^-i^xoq rro ,3&o*t-»-l«a &##-£# ft # «#£* oS *;AaYAtf 
sJivii^aH «Xi. <-"-T ~ . 9 'to j , ii*iS9l« .f*if2! »d^ . *&«£* ,Js,aj3 &s>iqos -si- 



r. 

f 






II. D. 3. AN ILLUSTRATION OF MODELING COMPLEX PICTURES 
BY PICTORIAL AGGREGATES 

This section presents a concrete illustration of the 
concept of modeling complex pictures "by pictorial aggregates 
The example is a process which implements part of a system 
for "editing," that is interspersing fragments from several 
distinct pictorial sequences, or 'scenes'. Each scene con- 
sists of a sequence of pictures, or frames. Suppose that 
these sequences themselves are included in a pictorial 
aggregate called S. SCENES. Suppose further that there is a 
pictorial aggregate called S. TAPES, each member of which is 
a picture consisting of a number of points equal to the 
number of frames in a corresponding sequence of S. SCENES. 
S. TAPES is a picture that portrays the quantity and length 
in frames of available scenes. Thus, if there are three 
scenes in S. SCENES, whose lengths are 20, 25, and 30 frames 
then there are three 'tapes' in S. TAPES, arranged in rows 
of 20, 25, and 30 points, respectively. 
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The editing system is implemented "by: 



DEFINE EDITINGSYSTEM; PROGRAM #10 

.11 SHOW S. TAPES; 

.12 SET PT.O to INPUT-, 

.13 SET TAPE.O to + PT.O; 

.Ik SET SCENE. to #(TAPE. OeS.TAPES)TH o{ S. SCENES; 

.15 SET FRAME. to #(PT. OeTAPE. ) TH o^ SCENE. 0; 

.16 WIPE S. TAPES; 

.17 SHOW FRAME. 0; 

.18 8EGINAT FRAME. In SCENE. 0; 

.19 WAITUNTIL BUTTON k OR BUTTON 5 OR BUTTON 6; 

.20 HIPE FRAME. 0; 

.21 IF BUTTON 5 THEN VO PART 21; 

.211 SET FRAME. to NEXT O^ SCENE. 0; 

.212 GOTO #.17; 
.22 IF BUTTON 6 THEN PO PART 22; 

.221 SET FRAME. to PREVIOUS oi SCENE. 0; 

.222 GOTO #.17; 
.23 IF TOG 1+ THEN GOTO #.31; 
.24 IF TOG 5 THEN RETURN; 
.25 GOTO #.ll; 

.31 PLAYBACK S.EDITEDSEQUENCE; 

.111 FOREACH PICO ^n SCENE. FROM FRAME . UNTIL BUTTON 7 
VO PART l+l; 

.1*11 SET PTR.O to PICO; 

.412 PUT PTR.O -twip S.EDITEDSEQUENCE; 

.1+13 SHOW PTR.O; 

.1*14 PAUSE {ok 1; 

. Ul5 HIVE PTR. 0; 
.1*2 GOTO #,11; 

EN2? 



The purpose of calling the system is to modify the 
edited sequence, the pictorial aggregate S.EDITEDSEQUENCE, 
which exists in some form prior to the call. The animator 
views the picture S. TAPES (#.11). To supply the input 
expected at #.12, he designates an element of one of the 
tapes with the stylus. (*8) The unique tape containing 
the designated point is identified at #.13. The scene cor- 
responding to the tape is identified at #.ll*. #.15 isolates 
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the frame whose position in the scene corresponds to the 
location of the point in the tape. This frame is displayed 
in place of the picture of the tapes (#.l6-.17). The 
implicit pointer of the aggregate representing the current 
scene is set to point to the current frame (#.l8). 

Wow the animator is expected to respond again. He may- 
step forwards along the scene, viewing each frame ( § . 21 ) , 
or he may search "backwards (#,22). He may recall the picture 
of the tapes and designate a new point on any one of them 
(#.25). He may terminate the execution of the system (#.2U). 
Finally, when he finds a suitable section, he can add it to 
S.EDITEDSEQUENCE (#.23). 

First, S.EDITEDSEQUENCE as now constituted is played 
hack (#.3l). Then pointers to successive elements of the 
current scene, beginning at the current frame {#.k±), are 
inserted at the end of S.EDITEDSEQUENCE ( #. Ul2 ) and made 
visible for a brief interval of time ( #. 1*13-. *H 5 ) . This 
action is terminated by a button push (#.Ul), after which 
the picture of the tapes is again made visible (#.^2). 

EVlTJhlGSySTEM as here defined is obviously not a com- 
plete editing system; at a minimum there must and can be 
added facilities for deleting frames from S.EDITEDSEQUENCE. 
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II.D.U. ILLUSTRATIONS OF MODELING GLOBAL 

DYNAMIC DESCRIPTIONS BY SCALAR AGGREGATES 



Global dynamic descriptions may be modeled, or repre- 
sented, directly by scalar aggregates. Thus the following 
program defines the sawtooth path description of II. A. h., 

Step kz 



PROGRAM #11 



PEFINE FORMSAWT00TH PATH o{ height and period and length; 

.11 NEWAGG PATH; 

.21 FOR 1=1 STE? 1 UNTIL (i>period) OK (SIZE i PATH 

= length) VO VUT (height x i/period) Into PATH; 
.22 IF SIZE oi PATH = length than RETURN; 
.23 GOTO #.21 

EHV 

The parameters of FORMS AWTOOTH are the name of the scalar 
aggregate representing the path description, the height of 
the teeth, the period of the teeth, and the total length of 
the path description to be computed. 

The process RECORVRHVTHM , defined by Program 8, illus- 
trates the real-time formation of a dynamic description. 
Those instants of movie time at which the button is depressed 
are recorded as successive values of a scalar aggregate re- 
presenting a rhythm description. 

Occasionally we have a pictorial representation of a 
path description, but require the description itself. For 
instance, execution of the process ACC EPTPCLiRl/E , defined by 
Program 7, results in the formation of a parametric curve 
representing a pair of path descriptions. To extract the 
vertical coordinate variations from this curve, we need 
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the following: 

PEFIWE EXTRACTY YPATH &Jtom P , PICTUREOFPATH ; PROGRAM #12 

.11 WEWAGG YPATH; 

.12 FOREACH PT.O In P .PICTUREOFPATH VO PUT V o £ PT.O 
Into YPATH; 

EWP 

Y coordinates of successive points in P . PI CTUREOFPATH become 
successive values of the resulting path description. The 
attribute "V jj . . . " operates on a point and yields its y 
coordinate. The path description, once extracted from the 
picture, is represented by the scalar aggregate YPATH. The 
command EXTRACTS would also extract the a path description 
from its standard waveform representation. 

The final example is a procedure which transforms a 
time-independent selection description and a rhythm descrip- 
tion consisting of a sequence of int ervals into a time-based 
selection description. (Recall the definitions in I.C.6.): 



PEFIWE SPREAD SD1 and RD Into SD2; PROGRAM #13 

.11 NEWAGG SD2; 

.12 8EGIWAT FIRST of RD; 

.13 FOREACH s In SD1 VO PART 13; 

.131 FOR i = l STE? 1 UNTIL i > THIS oj$ RD 
VO ?UT s Into SD2; 

.132 BEGIWAT NEXT o tf RD; 

EHV 
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II. D. 5. PICTURE-DRIVEN ANIMATION IK APPL 

In picture-driven animation, we recall, picture change 
is determined "by simple algorithms operating upon collections 
of static images (eels) and collections of global dynamic 
descriptions. Commands in the language that cause picture 
change are called PICTORIAL OPERATIONS. Pictorial operations 
may be roughly distinguished as determining continuous 
alterations of value, which we call continuous pictorial 
operations, and as determining discrete alterations of pic- 
ture structure, which we call discrete pictorial operations. 
Individual picture changes, such as occur in the construc- 
tion of static images, can be produced by pictorial opera- 
tions with parameters that are scalars. Ongoing picture 
change, resulting in animated displays, can be produced by 
continuous pictorial operations whose parameters are suc- 
cessive elements of path descriptions (continuous movement 
descriptions) and by discrete pictorial operations whose 
parameters are successive elements of selection descriptions 
(discrete movement descriptions). 

Examples of continuous pictorial operations applied to 
points are: "REPLACE X o <( PT.A by Xo^PT.B; ALTER 6 0$ PT.C 
by deltatheta; SCALEUP R o{ PT . D by expansionf act or ; " . The 
first command shifts the point PT.A horizontally and assigns 
it a new x coordinate identical to that of PT.B. The second 
command rotates PT.C around the origin by an angle 
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deltatheta. The third command leaves the angle invariant, 
but multiplies the distance of PT.D from the origin by the 
scalar expans ionf act or . The meaning of continuous operations 
when applied to pictorial aggregates will be discussed in 
the next chapter. 

Discrete pictorial operations include assignment state- 
ments, HIVE and SHOW commands, picture generators such as 
NEWPT , and commands that alter aggregate structure, such 
as 1MSEP.T and REMOVE. Their meaning when applied to pictorial 
aggregates will also be discussed in the next chapter. 

Picture-driven animation may be implemented in APPL by 
passing eel classes, expressed as pictorial aggregates, and 
global dynamic descriptions, expressed as scalar aggregates, 
as parameters to pictorial operations. Recall, from I.A.3-, 
the three critical commands given by the GENESYS animator in 
constructing the bouncing wedge of ' SPROINGBOINGZAP ' : 

FORMCEL l In the cla&6 p. WEDGE; 
SKETCHPCURVE P. WEDGE; 
PLAYBACK; 

These commands are defined by the following extensions of 
APPL, assuming, to simplify the programs, that picture 
change is limited to the switching of eels as determined by 
selection descriptions, and to vertical t r ans lat ional motion 
as determined by path descriptions: 
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VEVltiE FORMCEL n In the. ctcL&A P. CLASS; PROGRAM 1U 

.11 IF P. CLASS eP. CELCLASSES tkzn GOTO #.21; 

.12 WEWPIX P. CLASS; 

.13 PUT P. CLASS Into P . CELCLASSES ; 

.21 WEWPIX P.CEL; 

.22 INSERT P.CEL ^ nTH 0$ P. CLASS; 

.23 ACCEPTSKETCH P.CEL; 

EHV 

All eel classes are to be included in the pictorial aggregate 
P. CELCLASSES. Unless the class already exists (#.11), a new 
empty class is formed and put into the aggregate (#.12). 
Then a new eel is formed, appropriately inserted into the 
class (#.22), and finally sketched by the animator (#.23). 
(*9) 

VEEJUE SKETCHPCURVE P. CLASS; PROGRAM #15 

.11 WEWPTX P.PCURVE; 

.12 ACCEPTPCURVE P.PCURVE; 

.21 EXTRACT'S YPATH &A0m P.PCURVE; 

.22 #(p. CLASSeP. CELCLASSES) ■+ n; 

.23 INSERT YPATH (U nTH 1 YPATHS ; 

EA/P 

A parametric curve is initialized (#.ll), then sketched in 
real time by the animator (#.12). (*1Q) The variations of 
the vertical coordinate with time are extracted to form a 
path description (#.2l). (*ll) The path description is in- 
serted into a scalar aggregate YPATHS, whose elements are 
arranged to correspond to the eel classes in P. CELCLASSES 
(#.22-. 23). 
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And, finally: 

DEFINE PLAYBACK; PROGRAM #±Z 

.11 WAIT; 

.21 F0REACH P. CLASS In P.CELCLASSES VO PART 21; 

.211 #(P.CLASSsP.CELCLASSES) -> n; 

.212 MOl/IETIMETH o& nTH oh SDESCRIPTIONS - s; 

.213 MOVIETIMETH 0& nTH o\ YPATHS -+ ylocation; 

.211+ 5ET P.VISIBLECEL to sTH jf P. CLASS; 

.215 REPLACE V 0({ P.VISIBLECEL by ylocation; 

.216 SHOW P.VISIBLECEL; 
.22 PAUSE tfo* 1; 
.23 F0REACH P. CLASS In P.CELCLASSES VO PART 23; 

.231 #(P.CLASSeP, CELCLASSES) -» n; 

.232 (M0l/IETIME-1)TH Otf nTH & SDESCRIPTIONS -> s; 

.233 HIDE sTH 0(5 P. CLASS; 

.2U GOTO #.21; 

EWZ? 

Corresponding to each class is also a selection description 
contained in the scalar aggregate SDESCRIPTIONS. At each 
instant of movie time, elements of the selection description 
(#.212) and of the path description (#.213) associated with 
each eel class are retrieved. The element of each selection 
description chooses a eel from the corresponding class (#.2lU), 
Before being displayed (#.2l6), its center is translated by 
the element of the corresponding path description {#.215). 
At the next instant of movie time, the currently visible 
eels are first removed (#.23), before the image for that 
frame is constructed (#.2l+). 
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FOOTNOTES -- II. D. 



(*l) References J 6 and 77 survey a variety of data struc- 
tures and languages for their manipulation. 

(*2) Problems of implementation will be made severe lay this 
generalization. 

(*3) We also do not introduce, although we may later incor- 
porate, something comparable to Balzer's nice canonical 
form for data and function references, whose purpose is 
to minimize the syntactic differences "between expres- 
sions that retrieve and compute information: 

He (the user) may also decide that a piece of 
information should not "be supplied by a data 
reference on a collection (aggregate), but should 
be supplied by a function through a calculation 
or series of calculations on other information. 

( #i O What should happen if the datum already belongs to the 
aggregate is an open question. We favor considering 
it an error. Thus there can be no aggregate (PT.A PT.A), 
although PIC.D = (PT.A PT.B (PT.A PT.C)) is legal. 

(*5) To preserve the simplicity of the core language, the 
CONTEXT mechanisms should not be included in it, but 
rather be implemented via definitional extension of 
APPL. 

(*6) See pp. 7-8 of Reference 79 for a discussion of the 
syntactic sugar of accessing paths. 

( *7 ) The three interpretations correspond to the concepts of 
"call by value," "call "by reference," and "call by 
name," respectively. 

(*8) In principle, he could also type a name for the point, 
or write an abbreviation of its name to a character 
recognizer. 

(*9) Recall the definition of ACCEPTSKETCH in Program k. 

(*10) Recall the definition of ACCEPTPCUP VE in Program 7. 

(*ll) Recall the definition of EXTRACTY in Program 12. 
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II.E.l, ATTRIBUTES AND PROPERTIES OF PICTURES 

The last chapter demonstrated that the ability to create 
and manipulate complex pictures is enhanced by organizing 
them into structures called aggregates. In this formalism 
the animator may express some intuitive concepts of picture 
description — the inclusion of one picture in another and its 
consequent removal, the ordering of a sequence of pictures 
and the accessing of such elements as the first, last, and 
next of the sequence, and the establishment of a hierarchy 
of embedded pictures. Many intuitive concepts of picture 
description, however, may not be expressed gracefully with 
these mechanisms— the "type," or classification, to which 
a picture belongs, its location, orientation, or size, its 
visibility or invisibility, and the distance between it and 
another picture. The purpose of this chapter is to augment 
the formalism so that the animator may extend and enrich the 
picture description capability of his language. (*l) 

The Meaning of Attributes and Properties 

The major new concepts are the attributes and properties 
of pictures. An ATTRIBUTE is a function defined on a picture, 
one that yields a single value which may be a scalar, scalar 
aggregate, or another picture. (*2) The value of an attri- 
bute of a picture is called a PROPERTY. Properties may be 
retrieved as stored values, or computed from programs defining 
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the meaning of attributes. Some attributes are primitive, 
that is, built-in, to the base system; others can be defined 
through language extension. 

There are, roughly speaking, three kinds of attributes: 
CONTINUOUS ATTRIBUTES, which are mappings from pictures to 
real numbers (scalars), or sequences of real numbers (path 
descriptions represented hy scalar aggregates), DISCRETE 
ATTRIBUTES, which are mappings from pictures to integers 
(scalars) or sequences of integers (selection descriptions 
represented by scalar aggregates), and RELATIONAL ATTRIBUTES, 
which are mappings, that is, relations or associations from 
pictures to other pictures. Each kind will be illustrated 
by a reasonable choice of primitive attributes for a simple 
base system whose only pictorial primitives are points. 

Continuous attributes express, roughly speaking, the 
precise geometrical and textural determinants and qualities 
of a picture. Built-in to the base system are attributes 
of I (intensity), X and Y (rectangular), and R and & (polar) 
coordinates of points. Thus "X o <{ PT.A", if PT.A is a 
point, yields a scalar whose value is the x coordinate of 
PT.A. The system also guarantees that the continuous pic- 
torial operations introduced in II. D. 5- correctly set the 
values of these continuous attributes of points. For in- 
stance, both "ALTER J oi PT.A by I o h PT.A;" and "SCALEUP I 
0$ PT.A by 2;" result in a doubling of the intensity of PT.A. 
As we shall discuss below, geometrical coordinates of each 
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point are measured relative to the position of another point; 
this is controlled by the primitive relational attribute 
"ORIGIN/ oi . . .". 

Examples of continuous attributes that may be defined 
by language extension are the "SIZE otf" a picture, the 
"PISTANCE butwazn" two pictures, the "AREA ivuldl" an enclos- 
ing figure, and the "PENS UV0¥?0 I UTS within" a region. 

The base system contains no continuous attributes defined 
on pictorial aggregates, for there appears to be no single 
interpretation acceptable for all applications. Consider, 
for example, the concept of the x coordinate, or horizontal 
position, of a picture composed of a number of points. The 
most reasonable interpretation of its location is the x co- 
ordinate of the center of gravity of the figure. Another 
user, however, might wish to consider the intensities in the 
calculation, for example, by computing the "center of mass." 
Still another may prefer, in the case of a triangle, the x 
coordinate of that vertex whose horizontal position is be- 
tween that of the other two. Extensions of the meaning of 
existent continuous attributes, and the introduction of 
new ones are discussed in Section II. E. 3. 

Discrete attributes express, roughly speaking, classifi- 
cations of pictures into differing categories of structure, 
for example, primitive or aggregate, and "type", for example, 
point, rectangle, square. Discrete attributes also represent 
classifications of pictures into conceptually discrete 
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abstractions of their properties, for example, growing, 
shrinking, or remaining constant in size, or outside of, 
inside of, or overlapping a particular closed figure. There 
are three primitive discrete attributes: STRUCTURE, TYPE , 
and VISIBILITY . The corresponding primitive properties and 
their interpretations are given by the following rules: 



STRUCTURE o $ PICTURE = ATOMIC 

NIL 

UUARV 



TYPE o$ PICTURE 



MULTIPLE 



= POINT 

AGGREGATE 



VISIBILITY oi PICTURE = RISIBLE 

HIVVEhi 



iff PICTURE is a 
pictorial primitive 
iff PICTURE is a 
pictorial aggregate 
that is empty 
iff PICTURE is an 
aggregate containing 
only one element 
iff PICTURE is an 
aggregate containing 
more than one element 
iff PICTURE is a point 
iff PICTURE is an 
aggregate not also charac- 
terized "by another 
defined type 
iff PIC.TURE is visible 
iff PICTURE is invisible 



The following abbreviations may be used: 

STRUCTURE o i PICTURE = ATOMIC <*> PICTURE ISATOMIC 

MIL <^> PICTURE ISUIL 

UHARY «> PICTURE ISUUARV 

MULTIPLE <*> PICTURE ISMULTIPLE 

= POINT <*> PICTURE ISPOIWT 

AGGREGATE «*» PICTURE ISAGGREGATE 

VISIBILITY oi PICTURE = VISIBLE & PICTURE ISflSIBLE 

HIVVEH «> PICTURE ISfflPPEN 



TYPE oi PICTURE 



The interpretation of the discrete attributes STRUCTURE 
and TYPE will be developed in great detail in the next section. 
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Obviously they are defined on pictorial aggregates as well 
as on primitives. A point is VISIBLE when created, HIVVEN 
after "being used as the argument of a HIVE command, and 
VISIBLE once more after being used as the argument of a 
SHODJ command. Because there is no single "best" interpreta- 
tion of the VISIBILITY of a pictorial aggregate, its meaning 
must be defined by language extension. Extensions of the 
meaning of existent discrete attributes, and the introduc- 
tion of new ones are discussed in II. E. 3. 

Relational attributes express, roughly speaking, asso- 
ciations between a picture and another picture or aggregate of 
pictures. The only primitive relational attribute Is "ORIGIN 
0f$...". Execution of the command "SETORIGIN PT.A;" implies 
that PT.A will from then on be the origin of all newly created 
points. The command "MEASURE PT.B Illative, to PT.A;" causes 
the coordinates of PT.B and all points whose coordinates 
depend upon PT.B to be recomputed relative to PT.A. Execu- 
tion of "NO0RIGIN;" determines that, from that time on, all 
coordinates of new points are measured relative to the system 
origin, an invisible, unmoveable point named S YSTEMORIG I N . 

Some useful relational attributes that could be defined 
by language extension are the "HYPOTENUSE fj " a triangle, the 
"CENTER 0&" a circle, and the "MAXIMUM/ 0^" a waveform, that 
is, its absolute maximum. 

One major role of attributes is enabling the implicit 
specification of all those elements in a picture possessing 
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certain properties. The implementing mechanism is called a 
picture selection function , and it may be used wherever a 
picture is expected. Two typical examples, in a hypothetical 
extended version of APPL, are "...ALLTtfOSE TRI.O In P. TRIANGLES 
4VLlktk*t AREA 0& TRI.0<9...'\ and "ALLTHOSE PICO In PICTURE 
SUCHTHAT PICO ISMULTIPLE AMV ORIGIN oi FIRST oi PICO= 
SySTEMflRIGIN. . .". Application of a picture selection function 
upon a pictorial aggregate yields a new aggregate consisting 
of all those elements from the original aggregate which 
satisfy the given criterion. The elements are ordered in the 
new aggregate as they were originally. The result may, of 
course, be nil, unary, or multiple. Execution of the state- 
ment "AUTH0SE PIC. In PICTURE Auchtkat PICO ISTRIAWGLE -> 
P. TRIANGLES;" causes copies of all the triangles in PICTURE 
to he made and included in a new aggregate P. TRIANGLES. 
(This assumes that TRIANGLE has been defined as a new picture 
TYPE, that is, a new value of the attribute TYPE.) Upon exe- 
cution of "SET P. TRIANGLES to ALLTHQSE PICO -in PICTURE 
ALLCktkat PICO ISTRIAWGLE;", a new aggregate, containing all 
of the triangles that exist in PICTURE, is formed and called 
P. TRIANGLES. (Here, as in II. D. 2., the references to the 
triangles are copied, and not the triangles themselves.) 
"F0REACH PICO In PICTURE WHILE PICO ISTRIAWGLE VO PART 11;" 
may be used if elements of the implicitly defined aggregate 
are to be accessed but no new aggregate is to be formed. 
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This statement causes PART 11 to be executed on each tri- 
angle in PICTURE. 

How Attributes are Evaluated 

Properties, as we remarked at the beginning of this 
section, are sometimes obtained by retrieval of stored 
values, other times by computation. If the meaning of an 
attribute operating upon a particular class of picture is 
built-in to the base system, then the mechanism of obtaining 
the property is totally under APPL's control. Therefore, 
associated with each point is a data block containing the 
X, V, R, 9, I, ORIGIN, STRUCTURE, TYRE, and VISIBILITY co- 
ordinates of that point. Similarly, associated with each 
pictorial aggregate is a data block containing the STRUCTURE 
and TYRE of that aggregate. The system assumes responsi- 
bility for maintaining correct values for each of these 
properties. For example, if the command "ALTER R o£ PT.A 
by 2.0;" is executed, then the values of X o& PT.A and V £ 
PT.A are automatically updated as well. (*3) 

If the attribute is defined by extension, or if its 
meaning upon a particular class of picture is defined by 
extension, then the property is usually obtained by executing 
the program which implements the language extension. For the 
sake of efficiency, however, the user should have the ability 
to request explicitly that a property be stored and until 
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further notice retrieved rather than recomputed. The aspect 
of APPL which allows a user to make these requests depends 
strongly on the implementation and on APPL operating proce- 
dures, and hence is not yet well defined. In III.B., how- 
ever, we shall "briefly discuss the prohlems raised. 

How Properties are Assigned 

Some properties can he assigned directly by pictorial 
operations. The meaning of "setting a value of a pictorial 
attribute" depends upon whether the attribute is continuous, 
discrete, or relational, whether it is built-in or has been 
introduced by definitional extension, and whether the pic- 
ture's type is primitive or has been defined by a language 
extension. Furnishing APPL with single commands that in 
each case assign properties is a difficult problem, one which 
is related to the issue of "constraint satisfaction." (*h) 
We begin our discussion here, and continue it in the next 
two s ect ions . 

Consider the following four superficially similar 
statements: "REPLACE X o{ PT.A by 0.5; REPLACE VISTAMCETROMDJAL L 
OfJ PT.A by 0.5; REPLACE X orf TRIANGLE. A by 0.5; REPLACE AREA 
0^ TRIANGLE. A by 0.5;". The first statement is meaningful in 
the base system, for it refers to a primitive attribute of a 
primitive picture type. In order that the second statement 
be meaningful, the user must have defined by extension both 
the attribute PISTAWCEFROMWALL and the continuous pictorial 
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operation which sets it to a particular value. The former 
definition involves subtracting the x coordinate of PT.A from 
the x coordinate of 'the wall'; the latter definition in- 
volves a recalculation of the X, R, and 9 coordinates of 
PT.A. so that it be located the appropriate distance from 
the vail. Interpretation of the third command requires 
extension of the meaning of the attribute X to apply to all 
'triangles', assuming that TRIANGLE has been defined as a 
new picture TYPE. The fourth statement is similar, requir- 
ing definition of a totally new attribute. 

Prerequisite to understanding how these definitions are 
made is a better conception of the meaning of the discrete 
attributes STRUCTURE and TYPE. That discussion, to which we 
now turn, also contains an initial example of the extension 
of meaning of an attribute, that is, the Introduction of new 
values of TYPE. 
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II. E. 2. THE DEFINITION OF NEW PICTURE TYPES 

We begin by clarifying the distinction between STRUCTURE 
and TV?E. The tests for values of STRUCTURE, "IF PICA 
7SAT0MIC...", or "... ISN 7 /...." , or " . . . JSUMARV . . . " , or "... 
ISMULT1PLE. . ." can be used to ascertain the current "struc- 
tural state" of a changing picture. One may question, for 
example, if the aggregate formed by a picture selection 
function contains no elements, a unique element, or many 
elements satisfying the desired criterion. The same tests 
can be used in exploring a complex hierarchic aggregate, such 
as one representing a picture of a maze or a network. 

The function of the TYPE attribute is to distinguish 
classes of pictures which possess individual characteristic 
features, and specialized techniques for their construction, 
decomposition, and manipulation. The concept of picture 
"type" is one to which we are accustomed and which we find 
natural— we think of 'triangles' as differing from 'rectangles', 
and of an 'isoscoles triangle' as a special type of triangle. 
Searches or other iterative operations may conveniently be 
limited by indicating the type of picture to which the search 
should be restricted, e.g., "...ALLTHOSE PICO In PICTURE 
4>uck£ka£ PICO ISTRIANGLE. . .", or, expressed in abbreviated 
form, ".. .ALLTHOSE TRIANGLE. In PICTURE...". Attributes 
assume different meanings when applied to pictures of differ- 
ent type, e.g., the "AREA f$ " a circle is defined by one 
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computation algorithm, the "AREA ofi" a triangle "by another. 
Pictorial operations, when applied to two pictures of dif- 
ferent type, may similarly require two unique interpretations. 
Consider, for example, an algorithm that shades (fills with 
some texture) a square, and another that shades an arbitrary 
closed figure which may include "both convex and concave 
port ions . 

To make usable a new picture class that is defined in 
terms of primitive types, the extended language must contain 
mechanisms for constructing members of the new class from 
suitable components, mechanisms for selecting distinguished 
components, that is, decomposing a picture of the new class, 
and mechanisms for testing if an arbitrary picture belongs 
to the new class. Landin has called these mechanisms 

constructors, selectors, and predicat es , respectively. 

Bk 
Standish, significantly advancing the work of Landin and 

others, then presented 

...a method for defining and manipulating several 
varieties of data structures. This method consists of 
embedding a descriptive notation for data structures 
within a programming language in such a way that the 
resulting language behaves as a synthetic tool for de- 
scribing and constructing data and programs in a 
variety of application areas. 

In order that 

...we can organize our transactions with computers 
to achieve multiplication of effect without multiplica- 
tion of effort . . . , 

Standish proposed the goal that 
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...This definition facility should permit the 
programmer to describe with ease the data structures 
that are critical to a task and to formulate with 
ease the operations over these data structures that 
are necessary for describing the processes he intends 
t o carry out . ( *5 ) 

Standish's method, presented in a comprehensive and convinc- 
ing dissertation, seems to achieve this goal, for when the 
user defines a new data structure [a new picture TVPE , in 
our formalism], the system automat i cally provides the asso- 
ciated constructors, selectors, and predicates. (*6) Further- 
more, it is precisely these constructors, selectors, and 
predicates which are used in formulating operations over the 
new structures. Thus the power of the method stems from 
economy of specification, that is, what the user obtains 
automatically when he makes a single picture type definition. 

To illustrate the flavor of Standish's approach applied 
to the definition of a new class of pictures and expressed 
in our notation, we shall discuss one possible definition of 
a TYPE called LJhIE. The definition depends upon a choice of 
aspects of 'LINEness' that must be present if an aggregate 
of points is to be called a straight line. Suppose that a 
straight line must contain a distinguished start point and 
end point, and that all its constituent points must be collinear. 
Furthermore, it should be legal to define a straight line by 
specifying all its constituent points, in which case the system 
merely checks them for collinearity and records the TVPE in 
the aggregate's data block. It should also be legal to 
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specify only the start point and the end point, in which case 
the system will compute, according to some algorithm, an 
evenly spaced sequence of intermediate points. To achieve 
these results, the following procedure may be used: 



PEFINEATTRIBUTE TVPE o& PICTURE tobz LINE; PROGRAM #17 
.11 FJXSTRUCTURE ( (STARTPT : V01HT ) ( AUV *P0I MT ) ( ENDPT : POI NT ) ) 

.21 TRANSFORMERS^ 

.22 IF SECQHV ISWIi THEN VO PART 22; 

.221 SET SECOMV to CONNECTION oi STARTPT and EUVVT ; 

.222 RETURN; 

.23 IF PICTURE ISNOTCOLLIWEAR tke.n ERROR; 

.2!+ RETURN; 

.31 SUCHTHAT 

.32 PICTURE ISCOLLINEAR; 

ENP 

The introductory statement of Program IT indicates that 
LINE is to be the 'name 1 of a new picture type. Its basic 

structure is expressed by #.11, which is what Standish 

71 
calls an elementary descriptor and Cheatham, et al , call 

a mode descriptor . The first and third elements are to be 

aggregates containing single elements, the start point and 

end point, respectively. The second element is to contain 

all other points in the line; ANV indicates that there may be 

arbitrarily many of these. The term 'P01MT 1 represents any 

picture whose TVPE is POINT. 

#.21-24 constitute what Standish calls a constructor 

modifier . This is a description of operations to be carried 

out upon an aggregate, provided that its format corresponds 



-290- 



o 



to the structural pattern of the elementary descriptor, in 

rder to transform it into a LINE. There is first a test 
(#.22) if only the start point and the end point have been 
input; if this is the case, the system constructs the desired 
sequence of evenly spaced points intermediate to the pair by 
calling a relational attribute "CONNECTION of* ( # . 221 ) . The 
four occurrences of the selectors StCOUV, STARTPT, and ENPPT 
are assumed to apply to the straight line under construction, 
that is, "SEC0NP" is an abbreviation for "SECOND o£ PICTURE;". 
(STARTPT and ENPPT have been defined as selectors by their 
appearance in #.11.) If more than two points have been input 
in the appropriate format, then the system checks them for 
collinearity before designating the T/PE of the aggregate to 
be LINE (#.23). COLLINEAP is a predicate or picture state 
(see the next section), which is either true or false in 
describing a particular picture. Its definition, another kind 
of language extension, guarantees that "...PICTURE 
ISCOLLINEAR...", "...PICTURE ISNOTCOLLINEAR. . . " , "...PICTURE 
AREC0LLINEAR...", and "...PICTURE ARENOTC0LLINEAR. . . " have 
the obvious meanings. 

#.31-32 constitute what Standish calls a predicate 
modifier . This is a description of tests to be carried out 
upon an aggregate, provided that its format corresponds to 
that of the elementary descriptor, to determine if it can be 
considered a LINE. Thus, in order for an arbitrary picture 
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to have the TYPE LINE, it must not only satisfy the struc- 
tural pattern of #.11 out also the condition of #.32. 

This program functions as a declaration which results 
in an immediate augmenting of the system to include a con- 
structor MEWLINE, two selectors "STARTPT of and "EHVPT o $" , 
and a predicate, "7SLIWE". Their meanings can test he de- 
duced from a series of examples: 

(1) "NEO/LINE LINE. A ^om ((PT.A)(PT.B PT . C ) (PT. D ) ) ; " 
results in the formation of a pictorial aggregate named 
LINE. A, whose TYPE is LINE, if the points PT.A, PT.B, PT.C, 
and PT.D are collinear; otherwise, it produces an error. 

(2) "NEWLIHE LINE. A {/LOrn (PT,A PT.B PT.C PT.D);" results 
in a format error. 

(3) "WEWLIWE LINE. A {Kom ( (PT. A ) (PT. D ) ) ; " results in 
the formation of a new line with a computed sequence of 
points intermediate to PT.A and PT.D. 

(h) The selector "STAKTPT C^ . . . TT , when applied to a 
picture of TYPE LINE, yields its start point, that is, the 
point contained in the aggregate's first element. 

(5) The selector "EUVPT 0(5...*' functions similarly. 

(6) Assuming that (l) has been successfully executed, 
". ..((PT.A)(PT.C PT.B)(PT.D)) ISLIWE..." is true. (Compare 
the order of the points to that in (l).) 

(7) However, "...(PT.A PT.B PT.C PT.D) 7SLZNE..." is 
false. 
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In the example, the system uses the pictorial format, 
or elementary descriptor, and the constructor modifier to 
form a constructor, the pictorial format to form two selec- 
tors, and the pictorial format and the predicate modifier to 
form a predicate. Thus the formalism simplifies the intro- 
duction of new structures through the definition of construc- 
tors, selectors, and predicates by 

(1) providing a compact format in which all three can 
be expressed; and, 

(2) isolating that part of the specification, the 
elementary descriptor, which is used in forming 
all three. 



We still have much to learn about mechanisms for defin- 
ing picture types. 

Currently, because of the strange format for lines which 
was adopted for the purposes of this section, the command 
"NEWLINE LINE. A ifiom (PT.A PT.D);" generates a format error. 
With some measure of the similarity of one structural pattern 
to another, an intelligent system could perhaps guess what 
was intended. Alternatively, we can go beyond Standish's 
development and assume that the system attempts to execute 
the constructor modifier even if it registers a format error 
in matching the input data to the elementary descriptor. 
Then, we add the following "patch" to Program IT: 
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.211 IF FIRST ISATOMIC AHV SECOHV ISATOMIC ANV THIRP JSMJL 

THEW VO PART 211; 
.2111 SET FIRST to t FIRST; 
.2112 SET THIRP -to f SECQHV; 
.2113 TAKE SECOWD ^/Lom PICTURE; 

#.211-. 2113 will "fix up" the input aggregate so that 
its form is correct. By the time #.22 is reached, the picture 
will have been transformed to ( ( PT , A ) ( PT . D ) ) . 

Further generalizations are needed. With obvious syn- 
tactic conventions, "WEWLIWE LINE. A ^Jtom PT.A to PT.B;" 
would be correctly interpreted. More difficult to achieve, 
however, is "MEWLIWE LIKE. A ^ftom 0,0,0.0 to 0.1,0.1;", for 
the system requires a mechanism for automatically transform- 
ing properties into points. Even more difficult is "WEWLIWE 
LINE. A l?lom PT.A {Jo*. 0.5 at +120°;", which should generate 
a point at 0.5 unit distance from PT.A, in the direction 
+120°, and then construct a line between them. This latter 
example illustrates the problem of constraints . We still 
lack a good formalism with which to specify pictures (e.g. , 
straight lines) "implicitly," or "non-pro c edur ally , " and a 
corresponding mechanism which can operate upon such a spe- 
cification and a collection of pictorial data to transform 
it into a line, that is, to cause the pictorial data to 
satisfy the constraints of LlNEness. Stated somewhat dif- 
ferently, the problem Is that of finding a met a-1 anguage 
for specifying classes of picture structure by what are 
commonly called picture grammars, and a processor which, 
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II. E. 3. AUXILIARY DEFINITIONS OF PICTORIAL ATTRIBUTES 
AND OPERATIONS 



We are now ready to pick up some loose ends. Specifi- 
cally, we shall introduce methods by which the language can 
he extended to include: 

(1) new commands, such as pictorial operations; 

(2) new attributes, continuous, discrete, and re- 
lational; and, 

(3) new picture states, or predicates. 

The name of the command, attribute, or state being defined 
may "clash with," or be identical to, that of an existent 
command, attribute, or state. The new program is then said 
to constitute an auxiliary , or augmenting definition of the 
existent entity. As auxiliary definition would typically 
be made to refine the interpretation of the entity so that 
it pertains to a new picture TVPE. A family of augmenting 
definitions of a single attribute or operation, identified 

by a unique name, is called a "procedure" in GPL and a 

71 
"generic procedure" in BASEL (ELF). Our concept of aug- 
menting definitions parallels that found in papers on these 
two "extensible languages." 

Auxiliary Definitions of Pictorial Operations 

We have already discussed, in II. B., the definition of 
new commands, and we further assume that the system contains 
editing mechanisms with which the user can alter the definition 
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of an existing procedure or process. Under some circum- 
stances, however, adding an auxiliary definition is simpler 
than modifying an existent one. Consider, for example, the 
continuous operation of shifting a picture horizontally. 
The command "ALTER X 1 PT.A by 0.2;" Is meaningful in the 
base language. However, "ALTER X orf LINE. A by 0.2;" is 
undefined. The most reasonable interpretation would "be 
expressed by the following extension: 



PEFIWE ALTER X o<$ LINE.O by deltax; PROGRAM #10 

.11 ALTEU X otf STAKTTT o{, LINE.O by deltax; 
.12 ALTER X ol ENVFT ojj LINE.O by deltax; 
.13 FflREACH PT.O In SECOUV o{ LINE.O VO 
ALTER X o{ PT.O by deltax; 

ENV 

If "ALTER X 0*5 LINE. A by 0.2;" is encountered after this 
definition is made, the system first checks the new program 
to see if it can be applied. Since the TYPE of LINE. A is 
LINE, the system descends through its aggregate structure, 
retrieving in turn each point, and calling ALTER with the 
point as an argument. Now the parameter types of the new 
definition and of the call do not match, and the system 
successfully applied the initial, primitive definition. 
Thus, "shifting a line" is defined in terms of the shifting 
of its constituent points. 

This program, however, is applicable only to straight 
lines. If the shifting of any pictorial aggregate can be 
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defined recursively in terms of the shifting of all its 
constituent elements, the following program implements the 
operation of shifting any picture: 



DEFIWE ALTER X ofa PICTURE by deltax; PROGRAM Il9 

.11 F0REACH PICO In PICTURE VO ALTER X o& PICO by deltax; 
EHV 

When an atomic picture is passed to this procedure as an 
argument, or is encountered in descending through a struc- 
ture, the system cannot execute #.11, and so attempts instead 
to use the first definition. 

One advantage of the formalism is that it allows the 
user to provide non-standard interpretations of such opera- 
tions. Suppose, for example, that shifting a straight line 
horizontally by an amount 'deltax* is to mean that the right- 
most point be shifted deltax, the left-most point remain 
glued in place, and the intermediate points follow the moving 
one as if on a rubber band. Assuming that the "STARTPT &" 
and the "ENVVT fa " the line are the outermost points geome- 
trically, the task may be accomplished by: 

VEE1HE ALTER X ofa LINE.O by deltax; PROGRAM #20 

.11 IF X ofa STARTFT ofa LINE.O = X 0^ EHVPT otf LINE.O 

THEN RETURN; 
.12 IF X o<f STARTPT o& LINE.O > X ofa EHVPT o& LINE.O 

THEN ALTER X fa STARTPT ofa LINE.O ELSE ALTER X ofa 

EHVPT ofa LINE.O; 
.13 TAKE SECOHV ofa LINE.O faiom LINE.O; 
. lU HEOJLJHE LINE.O falom LINE.O; 

EHV 
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The program recomputes the location of the moving point 
(#.12), drops the existent set of intermediate points (#.13), 
and calls the constructor of straight lines to provide a new 
set (#.lU). 

Examples of pictorial operations that directly set the 
values of primitive relational and discrete attributes are 
"MEASURE PT.A KdlOLtivztQ PT.B;" and "SHOW PICTURE;". The 
former routines has at least one side-effect— a recalculation 
of the X, V , R, and G values of PT.A. Although the meaning 
of "SHOW PT.A;" is unambiguous, "SHOW PICTURE;", if PICTURE 
is of arbitrary structure, could have several meanings. 
Perhaps for one application all constituent points should 
he made visible, whereas, for another, only a particular 
subset of distinguished points should be shown. Hence the 
meaning of "SHOW..." must be refined through language exten- 
sion . 

Definitions of Attributes and Properties 

The problems and solutions in this domain are much the 
same as those discussed above. The attribute X, when applied 
to a straight line, could be defined by the following: 



PEFINEATTRIBUTE X o$ LINE.O; PROGRAM #21 

.11 RETURN ((X oi STARTPT oi LINE.O) 
+ (X Oi EUVPT Oi LINE.0))/2; 

ENP 
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If we adopt the convention that the x coordinate of any 
aggregate is the x coordinate of the first point encountered 
in descending recursively through the first element of the 
aggregate, then the following suffices to define the meaning 
of !I X OfJ" any picture: 



PEFIWEATTRIBUTE X o{ PICTURE; PROGRAM #22 

.11 RETURN X o$ FIRST oi PICTURE; 

ENV 

Totally new attributes may also be introduced, such as the 
following relational attribute; 

PEFIWEATTRIBUTE MIDPOINT of LINE.O; PROGRAM #23 

.11 NEWPT PT.MID CLt X 0^ LINE.O, Y { LINE.O; 
.12 SET PT.BEST to FIRST oi SECOND o£ LINE.O; 
.13 F0REACH PT.O In. SECOND oi LINE.O VO 

IF DISTANCE oi PT.O to PT.MID < DISTANCE oi PT.BEST 

to PT.MID THEN SET PT.BEST to PT.O; 
,1k RETURN PT.BEST; 

EMI? 

This program returns that point included in the straight 
line aggregate that is closest to the geometrical midpoint 
of the line. It assumes that "X o i" and "V {" a straight 
line yield the coordinate values of the geometrical midpoint, 
as they would if defined as in Program 21. 

Definitions of Picture States 

We have seen that some new predicates are formed as 
"by-products of type definitions. They can also be defined 
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directly, as in the fftli4ving£l£iriM*e*tioiii 



PEFIWESTATE PI(?a TOTffCRlGHTOf PIC.2; 
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FOOTNOTES -- II. E. 



ft n ft i 
( *1 ) Papers on graphic data-base systems ' for question 

answering and pattern recognition illustrate a richer 

picture description capability ("the circle is to the 

right of and bigger than the triangle, and is inside 

the rectangle") than is customarily found in synthetic 

computer graphics systems, that is in systems for 

constructing pictures (SKETCHPAD, BEFLIX, CAFE, GENES YS ) . 

The value of describing pictures by a complex set of 

relations has been amply demonstrated by the ease with 

which members of the TX-2 community have written and 

modified interactive graphics programs in the LEAP n„ 

Language for the Expression of Associative Procedures. 

LEAP augments the descriptive capability of a data base 

of associations with the implicit search and retrieval 

capability of associative processing ("find all those 

circles to the right of and bigger than the triangle, 

and inside the rectangle"). One of our goals is to 

place these powerful expressive tools in the hands of 

both the user and the builder of an interactive graphics 

system. This can succeed because APPL is the language 

of both the user and the system builder, whereas LEAP 

is the language of only the system builder. 

(*2) Here APPL is less general than LEAP, for the latter 

language allows multi-valued relations between objects, 
LEAP also considers one universe of items, which may 
appear as attributes as well as objects, whereas in 
APPL the set of attributes is disjoint from the set of 
data items, consisting of pictures and numbers. 

(*3) Whether it updates these properties immediately, or 

only "when necessary," is implementation-dependent and 
for the purpose of this discussion immaterial. 

(*k) See Footnote 5, LB. 

(*5) Standish, pp. 1,3,11. 

(*6) The constructors, selectors, and predicates for pictures 
of primitive TWE, that is for PICTORIAL PRIMITIVES, are 
built-in to the base system of APPL. The constructor 
for a POTWT is NEWPT , there is no selector, and the 
predicate is ISVOlhiT. 

(*7) For a recent survey of attempts to define grammars for 
various classes of pictures, see Reference 85. 



-302- 



III. A. SUMMARY AND CONCLUSIONS 

Experience in generating animated visual displays has 
shown that a computer with which one can interact directly 
and graphically, in real time, can be a powerful new medium 
for animation. The ability to see and alter a synthesized 
"movie" immediately is striking, for it cannot be achieved 
with traditional media and techniques. Interactive computer- 
mediated animation is the process of constructing movies by 
utilizing direct console commands, algorithms, sketches, and 
real-time actions. We have specified what is required for 
building interactive computer-mediated animation systems. 
We have Implemented and used three such systems on the M.I.T. 
Lincoln Laboratory TX-2 computer. Thus the dissertation 
proves that the process is now technically (although perhaps 
not economically) feasible, and that it therefore deserves 
further research and development. 

A process called picture-driven animation is a special 
kind of interactive computer-mediated animation that exploits 
the potentialities of direct graphical interaction. The 
animator may sketch and refine (l) static images to be used 
as components of individual frames of the movie, and (2) static 
and dynamic images that represent dynamic behavior, that is, 
movement and rhythm. These latter pictures, which eventually 
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drive algorithms to generate animated displays, depict data 
sequences called global descriptions of dynamics. Global dyna- 
mic descriptions abstract aspects of movement and rhythm 
which recur over extended intervals of time in particular 
animated displays. Picture changes that are continuous 
variations of value are expressed by path descriptions ; pic- 
ture changes that are recurring discrete choices of pictures, 
data, events, or actions are expressed by selection descrip- 
tions . Rhythm descriptions express patterns of the triggering, 
pacing, coordination, and synchronizing of picture change. 

Each global dynamic description determines critical 
parameters of a sequence of frames. Thus, with a single 
sketch or action that generates or modifies such a repre- 
sentation, the animator can exercise precise dynamic control 
over an entire interval of the movie. More specifically, he 
does this by (l) sketching and editing graphically static 
representations of dynamic descriptions, and by (2) mimicking 
in real time desired dynamic behavior. He communicates with 
the system about a movie in an intuitively natural "language" 
of pictures and sketches. 

Such a 'language" of pictures and sketches has been im- 
plemented in several closed animation systems. They are 
closed in the sense that the animator can only sketch into 
the system and command the computer to aid the sketching 
process; he cannot in this command language describe 
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extensions to the language, that is, he cannot define new 
commands and their meanings. The dissertation lays the 
foundation for the design of a multi-purpose, open-ended, 
Animation and Picture Processing Language. APPL is a conversa- 
tional language which accepts direct sketches, direct con- 
sole commands, and algorithms that control interactive dynamic 
displays. It has several features that distinguish it from 
existing on-line graphics languages: 

(1) The language can easily he augmented while remain- 
ing within the language; the system is, in a very 
powerful sense, extensible or open-ended. 

(2) Strictly sequential flow of program control is 
abandoned in favor of the quas i -parallel execution 
of picture-transforming algorithms. This facili- 
tates the specification and coordination of 
multiple strands of dynamic activity. 

(3) A data structure called the aggregate, which is 
a generalization of all hierarchic ordered data 
representations, is used to model both complex 
pictures and global dynamic descriptions. 

(U) An extensible class of picture descriptions 

called attributes , including one which abstracts 
the concept of picture "type," may be used by the 
animator to tailor a rich picture description 
capability to his own specifications. 

(5) The animator's dynamics as expressed through a 
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stylus, push-buttons, and other devices is included 
as an integral component of animated system "behavior. 
The stylus, for example, is modeled just as is any 
picture point, with the exception that its loca- 
tion cannot he set by a program. Thus the animator 
may write programs describing his own interaction 
with a movie as easily as he can algor it hmi cally 
generate a movie. 
The goal of the language design is plasticity in the repre- 
sentation of dynamic information and flexibility in the tech- 
niques and conventions with which the animator interacts with 
the system. It has been verified on paper that the language 
can be gracefully used to construct dynamic displays, to build 
system tools that aid the construction process, and to imple- 
ment special-purpose interactive computer-mediated animation 
systems . 
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III.B.l. DIFFICULTIES ENCOUNTERED IN IMPLEMENTING AND 
USING ADAM, EVE, AND GENESYS 

Specific observations and judgments shall "be made on 
the strong and weak points of the TX-2 graphics environment 
for the implementation and use of ADAM, EVE, and GENESYS. 
In the hope that such documentation will assist future 
workers in the field, we shall augment the general published 
literature on the TX-2 system ' "~ 9 with remarks specific 
to the application area of animation. (*l) We consider the 
following TX-2 subsystems: 

(1) the computer itself, including its hierarchy of 

89 
auxiliary storage; 

(2) the display processor; 

(3) APEX, the time-sharing monitor system; 
(h) the display executive subsystem of APEX; 

(5) the interrupt-proces sing executive subsystem of 



APEX; 92 



(6) the VITAL compiler-building system; and, 

(7) the LEAP Language for the Expression of Associative 

82 
Pro ce dur es . 

Some remarks in this section suggest avenues towards the 
design of supporting subsystems which could better facilitate 
interactive computer-mediated animation. Some of these re- 
search questions are posed in more detail in III.B.U. 
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The TX-2 and its storage hierarchy 

The TX-2 is an experimental, graphically oriented 
facility, usually time-shared among up to nine users, but 
frequently available for dedicated use. The system has ±6kK 
of core, a Fastrand II drum for bulk and swapping storage, 
and three magnetic tape units for back-up storage. 
Asset : There are five refreshed CRT's, two storage scopes, 
and a wide variety of input devices, including two stylus- 
tablet-comparator units, knobs ( shaft- encoder s ) , toggle 
switches, push buttons, and typewriters. 

Asset: The hardware is prepared to add new devices, and so 
it was relatively easy to add our computer-controlled movie 
camera . 

Asset: When running in dedicated mode, a user can occupy 
over 100K of core. 

Liability : The Fastrand II Is very slow as a swapping drum. 
Delays on the order of fractional to several seconds can 
easily be encountered in animation applications. Faster 
secondary memory is definitely required. 

Consequence : If programs or data representing a movie exceed 
the capacity of real core, then appropriate swapping must 
occur concurrent to computation or playback. To avoid de- 
lays in which the system waits for swapping, it must care- 
fully control the allocation of real core and the initiation 
of swapping. This can easily be done during the playback 
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of a sequence of frames, as we shall discuss "below. It is 
difficult to achieve during the computation of the sequence. 
To facilitate these tasks, the animation system itself, and 
the programs and data which define movies, should be factor- 
able into meaningful units. 

The display processor 

Displays are refreshed, from ring- struct ured files re- 
siding in main core, by a time-shared analog signal generator 
of points, lines, conic sections, and characters. 
Ass_et_: Points, lines, and conies are stored in a uniform 
homogeneous matrix representation. 

Ass et : Hierarchic structures of "groups" of display items 
may be established. A group may be "used" as an item in 
other groups, and the origin of each "use" given a unique 
offset. Thus, instances of a single subpicture can easily 
be placed at several locations on the scope. 

Liability : The same beam is used for refreshing both the 
static and the dynamic portion of the display. 
Cons equence : Excessive flicker results when pictures are 
complex or the system is under heavy time-shared use. ( *2 ) 
Movies are more likely to be display-bound, which occurs when 
frames cannot be painted on the screen in l/2Uth of a second. 
Impli cat ion : We have variable-speed playback in order to 
view display-bound movies at a slower rate. We need mechanisms 
for factoring animation sequences into parallel dynamic 
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strands, in order to reduce the complexity of the display by 
viewing separately different parts of the action in a movie. 
Asset : The hardware translates subpictures dynamically, 
through the group offset mechanism. 

Liability : The hardware has not yet been augmented to asso- 
ciate a single homogeneous matrix with each use of a group, 
and to multiply it into each picture matrix before display. 
Consequence : Rotation, scaling, windowing, and clipping must 
currently be done by software. This is either costly of 
playback time, if done during playback, or costly of movie 
computation time and storage space, if done while the movie 
is being calculated, and the resulting images are stored for 
subsequent playback. 

Implication : Addition of the hardware matrix multiplication 
would enable it efficiently to carry out dynamic rotation, 
scaling, and arbitrary projective transformations. 
Asset : Since a separate channel refreshes the scope, and since 
a user's display file is frozen in core, his picture remains 
Visible even while his program's execution has been inter- 
rupted in time-sharing. 

Liability : If the picture is a movie being played back, how- 
ever, playback stops and the current frame is held on the 
scope . 

Implication : A standard format for movie display files should 
be adopted, and the concept of holding the picture on the 
display extended so that playback could continue even though 
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other animation computations were interrupted. Given the 
format used by ADAM, EVE, and GENESYS , switching frames re- 
quires only disconnecting and reconnecting one link in the 
display file structure. Modifying the hardware so that the 
display processor could do this independently would not be 
difficult. 

The time-sharing monitor 

As s et : APEX provides services including resource allocation, 
scheduling, and protection for time-shared users. There are 
also commands with which they can manipulate files and allo- 
cate virtual core. 

Liability ; Although a user running in dedicated mode could 
be allowed to allocate directly that portion of real core 
unused by the monitor, this is not possible under APEX. 
Consequence : Swap-bound movies are more likely. 
Liability : The scheduling philosophy does not allow a single 
user in time-sharing to request short-term absolute priority, 
even if he is willing to pay the penalty later on. 
Consequence : Movie playback can be arbitrarily interrupted 
in time-sharing. Only when input functions can be totally 
assumed by the interrupt executive can real-time monitoring 
of the animator's movements and sketches be guaranteed. 
Hence, although we have prepared animation systems and par- 
tially debugged them in time-sharing, we rarely animate with 
more than one or two other users on the machine. 
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Liability : TX-2 programs operating under APEX have a push- 
down stack of virtual memories. However, only l6 "hooks" 
are allowed on each "map", or level of virtual memory, only 
one file may he put in a map, and communication between maps 
is difficult and time-consuming. 

Consequence : Partitioning, or factoring, of programs, data, 
and images is difficult to implement. 

The display executive 

Asset : This APEX subsystem provides mechanisms for initializ- 
ing, naming, saving, and retrieving display files; for build- 
ing display items, combining them into groups, and hierarchi- 
cally structuring these groups; and for interrogating an 
existing file to discover its hierarchic structure. 
Liability : The structuring and accessing mechanisms are 
quite limited. A picture that appears only once on the scope 
cannot be included in more than one group of pictures. 
Although the file is ring-structured, and each group is 
stored as a ring, the ordering of items within a group is 
inaccessible to the user, and items must be referenced by 
a pair of integers, a group ID and an item ID. 
Consequence : Most of the picture structure cannot be kept 
in the display file; an additional data base is needed. Up- 
dating and maintaining consistency between dual pictorial 
data bases adds significantly to programming complexity. 
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Liability : A display file is limited in size to one APEX 
"book, or 8K registers. Only one such file can be displayed 
or referenced at a time. The executive system provides no 
mechanisms for communication between files. 

Consequence : Since movies can easily exceed 8K of picture 
data, we have been forced to write our own mechanisms for 
communicating "between display files, for guarding against 
overflow, and for structuring movies as groups of files. 
Since time delays occur in switching from file to file, it 
is advisable to restructure them so that all constituent 
subpictures of a contiguous sequence of frames can be found 
in a single file. This too adds significantly to programming 
complexity . 

The interrupt executive 

Asset : This APEX subsystem provides mechanisms for requesting 
and releasing input services, and for specifying the condi- 
tions under which a program should be interrupted and given 
information about a device. This information consists of 
the name and the state of the device which caused the inter- 
rupt, and the states of other associated devices. 
As set : These services are provided continuously, regardless 
of whether or not a user program is running. Thus, they are 
capable of real-time monitoring of devices even under time- 
sharing . 

Asset : One of the services provided is the laying of a trail 
of "ink", consisting of a thinned and smoothed sequence of 
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points, over the trajectory of a free-hand sketch. 
Liability : Only 256 points may he entered before the pen 
"runs out of ink". This sometimes forces an animator to 
decompose a free-hand sketch in unnatural ways. 

The compiler-building system 

Asset: VITAL, a compiler-compiler in which language syntax 

is specified in Floyd Productions and language semantics 

is specified in Formal Semantic Language (FSL), allows the 

flexible construction and modification of compilers. 

Liability : FSL is useful for the algebraic component of a 

language, but is of little help in defining the semantics of 

list and associative processing. Therefore most of these 

semantics are written in assembly language. 

Liability : VITAL produces compilers which translate programs 

into non-relocatable, non-modular code. 

Consequence : This feature, and corresponding aspects of 

APEX, make program partitioning difficult. Thus, even small 

changes to a system are time-consuming because large parts 

of the system must be recompiled. 

Implication ; A compiler-building system for an interactive 

graphics environment should produce incremental compilers 

or interpreters . 

The high-level programming language 

Asset: LEAP is an ALGOL-like language augmented to facilitate 
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associative, display, and interrupt processing. It has teen 
used for building several interactive graphics systems now 
operational on the TX-2. 33 ' 3 Well-designed, high-level 
language forms allow one to structure and interrogate a data 
base, generate pictures, and monitor user input. The latter 
two tasks are achieved by LEAP'S making calls on the APEX 
display and interrupt executive systems. 

Liability: Little is understood about methods to achieve 
efficient processing of large associative data bases with 
conventional digital computers. 

Liability: Data bases can be saved and recalled, but merger 
and communication is difficult because all names in a data 
base are local to that structure. More fundamentally, no 
symbolic communication between LEAP programs is possible. 
This restriction is due in part to VITAL. 

Liability: Finally, we stress again the inconvenience of 
keeping pictures in both their LEAP and their display file 
representations . 

Problems with the implementation of ADAM and EVE, and the 
solutions employed 

ADAM and EVE are written in assembly code; the corres- 
ponding playback and filming programs are written in the 
algebraic subset of LEAP. In both cases, frequent calls are 
made on the time-sharing monitor, including its display and 
interrupt-processing subsets. 
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Problem : Currently, the movements of a single figure in 
ADAM can be computed at a rate of only h frames per second. 
Solution : Effective real-time viewing does occur in play- 
back, so the slow computing rate is of no consequence. 
Problem : Only approximately 100 frames of picture information, 
(12 lines per frame, from a single figure in ADAM, or a 
pair of figures in EVE) can be stored in a display file. 
Solution : Both ADAM and EVE fill sequentially a number of 
display files with adjacent frames. So that a long movie 
will not be swap-bound, the playback program reads the first 
n files into core, plays back the first one, and then begins 
to swap it out of core, replacing it with the(n+l)st while 
it plays back the second file, and so on. Despite its lack 
of direct control over real core, it can accomplish this by 
operating upon its virtual core. The success of this proce- 
dure in general depends upon the size of core memory, the 
size of each frame's representation in memory, the desired 
rate of playback, the maximum desired length of playback, and 
the speed of swapping when it is occurring simultaneously 
with the display. 

Problems with the implementation of GEHS SYS, and the solutions 
employed 

GENESYS and its playback and filming programs are written 
in LEAP with some assembly code interspersed. Little asso- 
ciative processing is used. Frequently calls on the monitor 
are made, particularly for display and interrupt services. 
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Unlike ADAM and EVE, GEJJESYS actually computes the 
movie during playback. ADAM must precompute complicated 
effects of several rotations and translations on each limb 
of the figure. In GENESYS, the algorithm which generates 
the movie is so simple that it is built into the display 
hardware. Each eel is stored in a unique group. Translation 
is achieved dynamically by changing the offset of the group. 
The selection among eels is achieved dynamically by switch- 
ing eels in and out of that part of the structure which is 
made visible by the display processor. Provided that all 
the eels fit in a display file, these operations can be done 
during playback without loss of speed. if the additional 
matrix multiplication were added to the display as suggested 
above, then dynamic rotation and scaling could also be effi- 
ciently achieved without storing large files of images. 
Problem : Since free-hand sketches are composed of long trails 
of points, flicker is a problem and movies easily become 
display-bound . 

Solution : Movies can be factored by working on only a subset 
of the eel classes at a single time. 

Problem : The eels required for an interesting animation se- 
quence can easily exceed a display file. 

Solut ion : Extra files must be generated according to the 
values of the selection descriptions, so that entire sequences 
of contiguous frames can be displayed without switching 
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III.B.2. WHAT TO DO NEXT IK PICTURE-DRIVEN ANIMATION 

We briefly review areas for further work already pro- 
posed in the dissertation: I.B.10. noted that GENESYS should 
he augmented so that arbitrary projective transformations of 
eels can he applied continuously under the control of path 
descriptions, so that dynamic hierarchies can he established 
by defining "macros" of dynamic descriptions, and so that 
generalized-eels can he integrated smoothly into the system. 
As we stated In I.C.7., further research is needed on the 
problem of coordinating parallel actions in a movie. I.C.8. 
discussed the need for more in-depth experimentation, in which 
animators would work with and comment upon the suggested 
techniques for defining and refining dynamic descriptions. 

We have constantly encountered and side-stepped the prob- 
lem of constraint satisfaction. More research is needed both 
on the general problem and on specific instances that occur 
in animation. The demands of animation are severe, for the 
set of constraints can change in each frame. 

Finally, further research should pursue the discussion 
of I.F. on "action-picture interpreters," on techniques for 
interpreting actions and pictures as representations of picture- 
transforming algorithms as well as representations of dynamic 
data . 
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III.B.3. THE IMPLEMENTATION AND FURTHER GENERALIZATION OF APPL 

We hope that our outline of the design of APPL is a step 
towards a better understanding of the role formal language 
structure can play in the construction of interactive graphics 
systems. The next step is to implement APPL. In the course 
of this implementation, some areas of the outline need to he 
made more specific, for example, language syntax, block struc- 
ture, and the choice of activity scheduling mechanisms. 

The base language described in the dissertation is a 
relatively "pure" algorithmic language, containing very few 
"declarative" constructs whose only function is to allocate 
storage and to aid the processor in efficiently executing 
algorithms. Thus, there is currently no way to tell APPL that 
an aggregate could be implemented by a fixed-length storage 
structure, what the upper bound is, and what kind of error 
signal should result from a reference that is out-of-bounds. 
To preserve APPL's clarity, the declarative components intro- 
duced in further development should be kept as distinct as 
possible from the procedural components. We shall discuss in 
the next section how this separation in the language could be 
reflected in the way APPL is used operationally. 

APPL's mechanisms for aggregation should be augmented 
so that they apply to commands as well as to numbers and pic- 
tures. APPL already contains one construct that is implicitly 
an aggregate of commands, the agenda. Further generalization 
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is needed to achieve the unification of the concepts of pic- 
ture (an aggregate of pictures) and action (an aggregate of 
commands, that is, events or activities) that was discussed 
in I.F. It should be possible to combine groups of commands 
that generate pictures in the same way that one can combine 
the pictures themselves. 

II. E, 2. suggested that there should be further research 
on the difficult problems of introducing new picture types 
and of extending the meaning of picture attributes. One aspect 
of this would be the search for workable interpretations of 
the TYPE of a dynamic picture, for example, "PEFI WEATTRZ BUTE 
TYPE oh LINE.O tobo, ROTATINGLINE;". 

Finally, there is an issue of APPL's design that has 
thus far been ignored, but should be tackled so that an imple- 
mentation can be as efficient as possible. Many animation 
sequences will be generated by several activities, or quasi- 
parallel computation strands. We will compute the sequence 
once, view the result, change one strand, compute again, and 
iterate in this fashion. APPL needs constructs with which 
the user and the system can cause images and other data 
resulting from computations to be stored and from then on 
retrieved rather than recomputed. This issue was mentioned 
in II.E.l. when we considered the evaluation of picture attri- 
butes . 

The problem can be phrased more succintly by extending 
the concept of "time" developed in II. C. 2. There are actually 
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three kinds of time, real time , movie time , and take time. 
Take time measures the number of trial computations, or takes , 
that must he executed in order to refine an animation sequence 
over a single interval of movie time. We say that a picture 
[property] is st at i c if its value is fixed over an interval 
of movie time, and dynamic if it changes in regular relation 
to the advance of movie time. In the latter case, it may he 
represented by a dynamic picture [description]. The dynamic 
picture [description] may or may not change as take time 
progresses. The problem is therefore one of identifying 
static pictures [properties], and storing them so that they 
need not be recomputed, and of identifying dynamic pictures 
[properties] that have stabilized at some point in take time, 
and storing them so that they need not be recomputed. As 
take time advances, activities defining the movie can be 
individually deactivated until none are remaining and the 
movie is complete, stored as part of the pictorial data base. 
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III,B.U. HOW SUPPORTING SUBSYSTEMS, BOTH HARDWARE AND 
SOFTWARE, COULD BETTER FACILITATE INTERACTIVE 
COMPUTER-MEDIATED ANIMATION 



Some hardware additions and modifications could make 
interactive computer-mediated animation more efficient and 
hence more economical. We have already suggested that: 

(1) The display processor could be given the capacity 
for directly multiplying picture items by homogeneous matrices 
which represent projective transformations. 

(2) The display processor could be given the capacity 
for playing back a movie without executing a user program, 
by cycling automatically through frames encoded in a 
specially-formatted display file. 

Other suggestions follow: 

(3) Algorithms implementing generalized-eels could be 
stored in special high-speed read-only memories. 

{h) Dynamic descriptions could be stored and retrieved 
from a cyclic memory device such as a drum, and not occupy 
valuable core, since the data are accessed sequentially during 
movie computation or playback. 

(5) In a similar vein, a display driven by a rotating 

91-91 
magnetic disk might be ideally suited for playing back movies. 

These have been used to drive low-cost graphic display termi- 

Q7_ QO 

nals which operate on television principles. (*3) The 
use of video tape as the movie storage and playback medium 
should also be considered. 
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(6) Finally, if conventional computer displays are 
employed to play back movies, then one should consider optically 
superimposing a static image from a storage tube with the 
dynamic image from a refreshed scope, thus enabling the latter 
to be more efficiently used. 

We shall also raise two fundamental issues of computer 
design which are relevant to computer graphics generally, and 
which suggest important areas for research. 

The computers of today have not been built to facilitate 
picture processing. Integers, fixed and floating point 
numbers, bytes, and bits are all primitives; pictures are 
not. Thus, commands to add two numbers, to shift a byte an 
integer number of places, and to take the logical product of 
two bit patterns are executed directly by current arithmetic 
units. Unfortunately, correspondingly basic operations for 
picture processing, such as superimposing two pictures, 
rotating a picture a number of units, and forming a line to 
connect two points, must all be expressed in terms of arith- 
metic and logical operations. Recalling the model for points 
developed in II.E.l., we can see that rotating a picture 
should result in an augmenting of its X and V coordinates as 
well as its Q coordinate. In a computer designed for picture 
processing, such operations could be carried out automatically 
by the hardware. 

Another fundamental problem arises in the implementation 
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of data bases which represent dynamic sequences, and the 
hardware and software mechanisms which interpret them. We 
noted in III.B.l. that maintaining dual pictorial data bases 
in current graphics systems is very awkward. What is needed 
is a single storage structure which can represent rich pic- 
ture descriptions (aggregates and properties), yet can contain 
as a proper subset that minimal information needed to display 
the picture. A corresponding display processor is needed 
which can generate the picture directly from the proper sub- 
set of the total, unified, pictorial data base. 

Next, we consider software subsystems and their rela- 
tionship to effective interactive computer-mediated animation. 

Again, we emphasize that the subsystems with which an 
animation system is implemented must facilitate the partition- 
ing of programs, data, and large files of images. 

If interactive animation is to succeed in time-sharing, 
then either the executive systems must assume all responsibility 
for generating real-time playback and for monitoring real-time 
input, or the monitor must allow an animation console to 
request absolute priority for brief intervals of time. 
Furthermore, these brief intervals cannot be assigned statis- 
tically; their occurrence must be predictable, granted upon 
demand, so that the animator can set himself to use the time 
effect ively . 

Finally, we suggest investigation of a new design 
philosophy for an interactive graphics system, one that 
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directly incorporates explicit roles for the animator, for 
the programmer, and for the computer. Suppose that the anima- 
tor and the programmer could communicate concurrently with 
the system from respective and adjacent consoles. Recall the 
previous section's discussion of the algorithmic and declara- 
tive components of the language. While the animator defines 
and manipulates pictorial aggregates, the programmer, under- 
standing the computational implications of the animator's 
activities, could furnish the system with information to help 
it allocate storage efficiently and make sensible implementa- 
tion choices. Presumably the programmer would try to anticipate 
what information will be needed, although the system could also 
automatically direct queries to the programmer. The approach 
would be effective insofar as it allowed the animator to 
continue his work without interruptions and without concern- 
ing himself with details of the computer processing. 
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III.B.5. THE FEASIBILITY OP INTERACTIVE COMPUTER-MEDIATED 
ANIMATION 



The dissertation establishes that interactive computer- 
mediated animation is currently feasible on an experimental 
basis. Its economic and practical viability, present and 
future, depends strongly upon three factors: 

(1) The ability to solve certain technical problems, 
so that the resulting films will be commercially acceptable; 

(2) The ability to reduce costs through economical 
system design, and through appropriate management of a wide 
variety of human and technical resources; and, 

(3) The ability to find a common "language" for anima- 
tors, artists, educators, and computer scientists. 

(l) There are many technical problems in the produc- 
tion of commercially acceptable film. Some of them, such as 
synchronization of visual and sound tracks, are encountered 
in all animation processes. In this case, use of the computer 
may lead to solutions more elegant than those of the past. 
(*k) In picture-driven animation, sound track waveforms or 

rhythm descriptions obtained from them could be displayed as 
are other dynamic descriptions. 

The problem of generating color film will soon be solved 
in principle, when color scopes are generally available, al- 
though accurate control of hue, saturation, and intensity 
will still be difficult. Even in black-and-white, picture 
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quality will vary unless ve use high-performance scopes whose 
intensity, spot size, and line thickness can be precisely 
controlled. 

We still need better descriptions and generative 
mechanisms for shape, line quality, and texture. Unless 
video playback techniques are adopted, it is difficult to 
view in real time intricate, rapidly changing shapes and 
textures. This is not necessarily a serious liability, since 
many animators strive for simple dynamic effects. (*5) 

Finally, one can consider- the possibility of animation 
in three dimensions, which raises the difficult problem of 

"hidden-line elimination." It appears unwise and unnecessary 

__ 100 . 
to deal with the complexities of drawing in true 3D. A 

more viable approach is to work on a stack of parallel pic- 
ture planes, and to obtain the illusion of depth through 
motion, through control of the size of objects, and through 
the elimination of hidden lines. 

(2) An animation system has been designed economically 
if it allocates resources in correct proportion to the needs 
of the animator at a particular moment. Some work can easily 
be done in conventional time-sharing despite sluggish response; 
other work, as was noted in III.B.l. and III.B.U., requires 
absolute priority. The demand for response from an inter- 
active graphics console is far more variable than that from 
a typewriter console. We need better models with which to 



-329- 



describe, estimate, and satisfy these demands, without the 
expense of totally occupying a large computer. There should 
also he research on the possibility of using a small computer 
augmented by secondary memory with rapid parallel information 
transfer . 

We also need to find ways to organize the creative 
efforts of a wide variety of human and technical resources, 
such as animators, artists, educators, computer scientists, 
conventional digital computers, analog input devices, and 
video tape and associated television equipment. 

(3) Successful computer animation requires finding a 
common "language" for individuals whose backgrounds and ways 
of thinking are exceedingly diverse. They must be better 
able to communicate effectively their respective insights 
into the animation medium and into design features for anima- 
tion sy st ems . 

I hope that APPL may be a positive step towards the 
required language. Because APPL unifies the processes of 
defining dynamic displays and defining an animation system, 
much of the medium's mystery can be removed. Users should 
better understand that the computer animation medium, unlike 
any other animation media, can to some extent adjust to their 
styles and to their needs. They should also better under- 
stand what aspects of a system can be changed, and what 
aspects cannot be changed. It is our hope that the continuity 
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III.B.6. APPLICATIONS OF INTERACTIVE COMPUTER-MEDIATED 
ANIMATION 



We note in the Introduction the demonstrated significance 
of the computer in aiding our understanding of the dynamics 
of complex natural phenomena through simulation and display. 
With interactive computer-mediated animation we can generate 
educational films that are primarily drawn rather than com- 
puted, for use in subject domains as diverse as the humanities, 
the arts, and the social sciences. 

Various modes of educational filmmaking can be imagined. 
For example, a teacher could q_uickly generate with GENESYS a 
crude animation sequence, tailored to the needs of his indivi- 
dual class. Then this film, or one made with APPL, could be 
used as the basis for generating a family of movies with the 
same "cast of characters." 

We still have much to learn about educational filmmaking. 
In a current paper, Huggins and Entwisle eloquently de- 
scribe the role of computer animation in fulfilling the 
great untapped potential of "iconic modes of communication 
and instruction," in producing "visual images that in their 
ability to communicate ideas are superior to traditional 
graphical images on paper or blackboard. Instead of static 
images, words, and mathematical symbols," they suggest, "we 
may create dynamic signs that move about and develop in self- 
explanatory ways to express abstract relations and concepts. 
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...A dynamic dimension is now available that requires the 
invention and development of new conventions and visual syntax 
appropriate to this new medium if it is to he fully used for 
communication and education." Huggins and Entwisle are 

pursuing these goals in the context of producing computer 

27 
animated films for engineering education. 

Generating dynamic displays interactively should benefit 

those seeking to construct and film stimuli for experiments 

^ 102-103 
on visual perception, such as the perception of movement, 

10U 
the perception of emotion in facial expressions, and the 

105 
perception of causality. 

Colby is attempting to stimulate language development 
in nonspeaking mentally disturbed children by allowing them 
to interact with alphabet symbols and pictures of objects pre- 
sented on a display, augmented by keyboard and voice communica- 
tion. He is interested in introducing motion into these 

107 
images . 

The stick figure work suggests several extensions and 

applications. There is currently much interest in analyzing 

human body movements for bio-engineering uses such as the 

1 aD 

construction of artificial limbs, and experimentation with 
synthetic models at an interactive display might prove a use- 
ful adjunct to this work. One could attempt to animate the 

outlines of figures by reducing them to a "stick figure" with 

109 
Blum's Medial Axis Transform, animating the resulting 
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FOOTNOTES — III.B. 



(*l) Reference 8? is a 19&9 review article on the TX-2 

experience with interactive graphics in a time-shared 
environment. Issues of the Semiannual Reports of 
Reference 88 furnish a chronological account of recent 
developments at the TX-2. 

(*2) Large display files and excessive flicker result in 
part because we have portrayed free-hand curves by 
closely spaced sequences of points, and not approxi- 
mated them with conic sections. For a hardware and 
software approach to the generation of approximating 
segments, see Reference 95; other software approaches 
are described in Reference 62 and 96. 

(*3) Reference 97 reviews three recent approaches to low-cost 
computer display terminals, including two which are 
based on television techniques. 

(*U) See I.B.8., particularly Footnote 7, and also I.F.'s 
discussion of the Computer Image technique for auto- 
matically generating cartoon character mouth movement s 
which are synchronized to the speech waveform. 

(*5) Whereas the computer is ill-suited to the "Disney 
style" of animation, it is well-suited to the more 
modern "U.P.A, style." These styles are described by 
the British animator John Smith (Halas and Manvell, 
p. 221} as follows: 

Generally speaking, the overall aesthetic 
attitude favoured in Disney's cartoon films is 
balanced in the following way. Complexity of 
detail is matched by complexity of movement. 

For example, when a figure walks, his tongue 
may flap, his hair flop, his ears wiggle, his 
eyelids shutter, his adam's-apple oscillate, his 
whole body down to his feet fluctuate with added 
movements. The rich, even sugary colouring and 
bulbous forms are matched by movements that 
resemble a bladder of water moving (if it could), 
floppily and sensuously. The sentimentality of 
mood is matched with coy, cute, sprightly, easy 
movement, and sadism by excessive distortion 
and squashing. In general, life is portrayed as 
it might move in a land where people had brains 
and bodies of soft sorbo rubber. 
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The matching of pictorial form and mood to 
design in U.P.A. films is, of course, very dif- 
ferent. U.P.A.'s artists favour s impli city, of 
form and simplicity of movement , the essence 
without the frills. Acid colours and sharp 
forms are matched by a movement resembling the 
way in which cane, glass and wire would move 
(if they could), springy, whippy, staccato. The 
wit and cynicism of these cartoons is acted out 
in slapstick of a high but blase kind. In general, 
this is life as it would be led in a land where 
people had brains and bodies of sheet metal. 
(Emphasis added) 
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APPENDIX 0: 

MULTIPLE-CHOICE EXAMINATION 
by Miss Patricia Lewis and Mr. Ronald Baecker 



For the benefit of academically-oriented readers, 
multiple-choice quiz is appended. 



a s hort 
ppe 



SELECT THE BEST ANSWER: 

(1) ADAM does not have a head because: 

(a) very small ellipses are distorted by the TX-2 scope: 

(b) the computer dropped a bit; 

(c) in reality, his name is Ichabod Crane; 

(d) just when the head was to be included, the size of 
the program reached a file boundary; 

(e) the answer may not be ascertained from the 
di s s ert at i on . 

(2) EVE is : 

( a ) a snake ; 

(b) the original swinger; 
( c ) as erpent ; 

(d) a multiple personality; 

(e) a collection of rubber-band lines. 

(3) A crocodiless is: 

(a) a female alligator; 

(b) a male alligator; 

(c) a typographical error; 

(d) a female crocodile; 

(e) a female caiman; 

(f) a mythical beast. 

(h) Computers are valuable in animation because: 

(a) they think; 

(b) they cannot think; 

(c) they are sorcerers' apprentices; 

(d) none of the above; 

(e) none of the below; 

(f) all of the below; 

(g) none of the above. 

(5) A reason for inviting artists and animators, unfamiliar 
with computer graphics, to sketch into GENESYS is: 

(a) because Mr. Baecker cannot draw; 

(b) because they are very enthusiastic; 

(c) because they are often young and beautiful women; 

(d) because they are the clients for whom this work is 
intended . 
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